This week, I had an experience that starkly highlighted the limitations of AI tools like ChatGPT and Google’s Gemini. As someone who has fully embraced the potential of AI, I remain optimistic about its long-term uses. However, it’s crucial to temper our enthusiasm with realistic expectations; AI cannot solve every problem flawlessly.
My challenge revolved around a specific project: my daughter is finalizing her doctoral dissertation, and she needed a map comparing the borders of the Byzantine Empire in 379 AD and 457 AD.
I crafted the following prompt after conducting thorough research:
Create a detailed map that overlays the borders of the Byzantine Empire in 379 AD, at the start of Theodosius the Great’s reign, versus the borders in 457 AD, at the end of Marcian’s reign. Both borders must be clearly shown on a single map.
Use a historical map style and highlight major cities.
The Deep Research option in ChatGPT is powerful, but not without its challenges. While it effectively generated a comprehensive text analysis detailing the shifting borders, prominent cities, and key historical events, the true test came when I asked it to convert this analysis into a readable map.
When I received the map, it was riddled with inaccuracies: cities were misspelled or misplaced, and some locations, like Rome, appeared multiple times. Frustratingly, the correct names and locations were clearly present in the text. I tried suggesting corrections, but responses were unsatisfactory. Eventually, I expressed my dissatisfaction, to which ChatGPT acknowledged my frustration. Despite its good intentions, the results did not improve.
Determined to find a better solution, I decided to try Google Gemini using the same query. To my surprise, the results were even worse, with Rome misplaced in the Iberian Peninsula and other false city placements that seemed to come from a fantasy world.
Later, I shared my mapping fiasco with a friend who recounted a similar tale. He asked ChatGPT to add text to a photo from a meeting. Instead of simply overlaying the text, the AI transformed the image drastically—altering the features of people within it. Another acquaintance mentioned that an AI-generated biography inaccurately stated he had children he does not have, even citing a link to a nonexistent source. These anecdotes underline that while AI can be useful, it is also prone to making glaring errors.
As Ronald Reagan famously said, “Trust but verify.”
My intention isn’t to suggest that we abandon AI. Instead, it’s important to remember that we can’t just hand over the reins to these machines and assume everything will be perfect. They are tools that require our supervision; we must examine the outputs critically and determine their accuracy and relevance. The performance of AI varies widely—sometimes quite effective, but other times disappointingly inaccurate, particularly in specialized tasks like mapping.
So, what can you expect from AI tools regarding accuracy? It’s advisable to remain vigilant and always verify results. Each implementation can vary in quality, emphasizing the necessity for user involvement.
What limitations do AI mapping tools have? AI mapping tools often struggle with contextual accuracy and historical data placements, which can lead to significant errors and misrepresentations.
Can AI replace human experts in research and mapping? While AI can assist in data gathering and visual representation, it cannot replace the nuanced understanding of a human expert, particularly in complex subjects like history.
What should you do when AI fails to meet your expectations? It’s crucial to remain proactive by providing clear feedback and reviewing outputs critically while considering alternative methods for the tasks at hand.
Ultimately, while the realm of AI is expanding rapidly, there’s still much to be done before we can fully trust these systems without oversight. Today may not be the day machines take over, but they can still be valuable assistants in our journey toward innovation.
Encourage yourself to keep exploring the possibilities of AI while ensuring you remain in the driver’s seat. Discover more at Moyens I/O to see how you can harness technology effectively in your own pursuits.