ChatGPT Health was launched earlier this month with features that integrate various health data sources, including Apple Health. However, a recent experience shared by technology columnist Geoffrey A. Fowler revealed significant shortcomings in the service's performance. After granting ChatGPT access to his health data, which included 29 million steps and 6 million heartbeat measurements, Fowler received a poor evaluation of his cardiac health, rated an F.
Following this alarming assessment, Fowler consulted with his doctor, who reassured him that he was at low risk for heart issues, contradicting the AI's analysis. The inaccuracies stemmed from misinterpretations of health metrics, such as VO2 max estimates that Apple provides, which are not precise measurements. Furthermore, inconsistencies in grading emerged, with Fowler's score fluctuating between an F and a C during multiple inquiries.
Despite having access to comprehensive health data, ChatGPT often overlooked critical personal information, including Fowler's age and recent blood tests. This raises concerns about the reliability of AI-driven health assessments. Meanwhile, Apple is reportedly developing its own AI health service, Health+, which may need to address these quality issues to establish itself successfully in the market.