How does the iOS app signing and provisioning system work? What are certificates, provisioning profiles, and why are they needed?

Sample answer preview

iOS code signing is one of the most confusing aspects of iOS development for newcomers, but understanding it is essential because every iOS app must be signed before it can run on a physical device or be distributed through the App Store.