Apple Blocks AI-Powered Email App Update Over Concerns of Inappropriate Content Generation

Apple has rejected an update to email app BlueMail from its App Store, citing concerns over the potential generation of inappropriate content for children. The app uses ChatGPT, a language model developed by OpenAI, to generate text based on past emails and help users write new ones.

In a statement, Apple's app-review team wrote that 'your app includes AI-generated content but does not appear to include content filtering at this time.' They demanded that the developer, Blix Inc., enforce a 17+ age restriction before allowing the app on the store. However, BlueMail cofounder Ben Volach disagrees with this decision, claiming that Apple's demand is unreasonable.

The rejection follows a history of tension between BlueMail and Apple. The two companies have been at odds over the cut Apple takes from App Store transactions. BlueMail was one of the founding members of the Coalition for App Fairness, alongside Epic Games, to challenge Apple's policies.

Apple has blocked other AI-powered apps without age restrictions in the past, leading Volach to question why BlueMail is being singled out. He also pointed out that his company had previously filed a lawsuit against Apple over its Sign In With Apple feature, which was later dropped.

The rejected update included new features designed to help users write emails more efficiently using AI-generated text. The app's developers argue that the inclusion of AI-generated content does not necessarily mean it will generate inappropriate content for children and that the 17+ age restriction is too broad.

In response to Apple's rejection, BlueMail filed an appeal with the App Review Board, citing the lack of evidence to support the claim that the app could potentially generate adult content. The company has also challenged Apple's decision in a statement, emphasizing that they do not believe the app's AI-generated content poses a risk to children.

The controversy highlights the ongoing debate over how to regulate AI-powered apps and ensure they are safe for users of all ages. As more apps incorporate AI technology, it remains to be seen whether Apple will continue to block updates with similar features or adopt new guidelines for developers.

'Apple Store Apps'

Apple store apps