A startling 70 to 80% of AI projects face setbacks. Two years after the commercial launches of ChatGPT and Stable Diffusion sparked a wave of AI-powered services, successful cases remain the exception rather than the rule. Understanding exactly where these projects go wrong, and why, is the clearest path to getting AI right.
Common Pitfalls in AI Services
1. Are your interfaces working against users?
AI models like ChatGPT and Stable Diffusion rely on prompt-based interfaces. While versatile, these interfaces often fail for specific tasks because they struggle to decipher user intent from ambiguous prompts.
Recommendation: Develop interfaces that surpass the capabilities of a standard prompt input box. Design systems that seamlessly follow intended scenarios without demanding heightened user attention.
2. Is service quality degrading over time?
Services with subpar interfaces sometimes achieve early success, but failed AI services suffer from both interface and service quality issues. Models designed for general use, like GPT-4, struggle to excel in specific tasks without additional fine-tuning.
Recommendation: Prioritise prompt engineering to control AI models effectively. Consider fine-tuning for specific tasks if general-purpose models fall short.
3. Are escalating costs making your service unsustainable?
The reliance on paid APIs or proprietary GPU servers makes sustaining AI services challenging without compelling users to pay individual fees.
Recommendation: Explore strategies to mitigate operational costs, including potential direct model execution on users' devices.
Common Pitfalls in AI Projects
1. AI is not app development: a fundamental misstep
AI projects require a data-centric approach, emphasising data collection, processing, and understanding over traditional code development.
Recommendation: Adopt a data-centric approach to AI projects, prioritising data over code. Understand that AI projects are fundamentally different from traditional coding endeavours.
2. ROI misalignment: navigating without a true north
Aligning the project with tangible business goals is crucial. Vague objectives and misaligned expectations regarding ROI often lead to project derailment.
Recommendation: Clearly define the problem you aim to solve and assess whether AI provides a cost-effective solution.
3. Data quantity: the lifeblood of AI
Inadequate data volume hampers the system's ability to learn and make accurate predictions, impacting the effectiveness of the AI solution.
Recommendation: Ensure sufficient data quantity to allow AI systems to learn effectively.
4. Data quality: garbage in, garbage out
The quality of input data significantly influences the success of an AI project. Poor-quality data leads to flawed models and unreliable outputs.
Recommendation: Invest time in cleaning, transforming, and preparing data to avoid flawed models and unreliable outputs.
5. Proof of concept or proof of confusion?
Proof of concept (PoC) projects often fail to translate into successful real-world applications. Testing AI solutions in real-world scenarios is crucial for practical viability and effectiveness.
Recommendation: Test AI solutions in real-world scenarios to understand their practical viability and effectiveness.
6. Training data vs real-world data: bridging the divide
Aligning AI models with actual operational data and conditions is essential for practical viability.
Recommendation: Evaluate and align AI models with actual operational data and conditions.
7. Resource underestimation: the invisible iceberg
AI projects demand significant time and financial investment. Underestimating resource requirements often leads to project failure.
Recommendation: Allocate sufficient budget and time for critical components like data acquisition and preparation.
8. Neglecting AI maintenance and evolution
AI models require continuous updates and maintenance to stay relevant. Lifecycle planning is essential for AI project success.
Recommendation: Plan for the ongoing iteration of AI models and data to avoid outdated models.
9. Falling for vendor hype
Thorough research is crucial to ensure that the chosen AI solution aligns with specific project needs.
Recommendation: Avoid succumbing to industry hype and focus on solutions that genuinely fit your requirements.
10. Overpromise, underdeliver syndrome
Setting realistic expectations is key. Overpromising on what AI can achieve often leads to project failures.
Recommendation: Understand AI's limitations and clearly define the scope of the project to manage expectations effectively.
Understanding and addressing these common pitfalls are crucial for the success of both AI services and projects. By adopting a data-centric approach, aligning projects with clear business goals, ensuring adequate data quality and quantity, testing in real-world scenarios, planning for ongoing maintenance, and setting realistic expectations, organisations can significantly increase their chances of AI success. AI is a powerful tool, and its effectiveness depends on how well it is understood, implemented, and maintained.
If you need further insight on how to utilise AI within your business, get in touch with our team via the contact page.