Robert Whitney
Jan 29
Business mishaps – table of contents:
How to avoid business mishaps when implementing AI?
Business mishaps in AI can have serious consequences for companies, so you need to test machine learning systems very carefully before bringing them to market. Otherwise, large investments in new technologies can end in a major financial and reputational disaster.
So how do you avoid business mishaps when implementing artificial intelligence? While the first piece of advice may seem too simple to work, it is: “Pay attention to data quality!”
The second piece of advice concerns extensive testing in a closed environment before releasing the tool to the public. You should not only test the technical performance of the tool but also verify its:
- ethical compliance — the goal of the tests is to reduce the bias and stereotypes reproduced by AI,
- legal compliance — verifying that the data used by AI tools, as well as the content they generate, comply with the country’s laws.
Even the giants in the field of artificial intelligence are not following this advice today, releasing chatbots into the world labeled as “early experiments” or “research projects.” However, as the technology matures and laws governing the use of artificial intelligence come into effect, these issues will become more pressing.
Google Photos
The list of business mishaps related to the use of artificial intelligence begins with a case from 2015. That’s when the Google Photos app, which used an early version of artificial intelligence for image recognition (computer vision), incorrectly labeled photos of black people as photos of gorillas. This business mishaps happened because the training data set used to teach the algorithm contained too few photos of black people.
What’s more, Google had a similar problem with a Nest smart home camera, which misidentified some dark-skinned people as animals. These incidents show that computer vision systems still have trouble recognizing the characteristics of different races.
Business mishaps: Age discrimination
In 2023, iTutor Group agreed to pay $365,000 to settle a lawsuit over the use of discriminatory recruiting software. The software was found to have automatically rejected female candidates over the age of 55 and candidates over the age of 60, without considering their experience or qualifications.
Amazon failed similarly business mishaps. Back in 2014, the company was working on AI to help with the hiring process. The system struggled to evaluate female candidates’ resumes because it was learning from data that included mostly documents submitted by men. As a result, Amazon abandoned the project to implement artificial intelligence in the process.
These cases show that automating the recruitment process carries the risk of perpetuating bias and treating candidates unfairly.
Source: DALL·E 3, prompt: Marta M. Kania (https://www.linkedin.com/in/martamatyldakania/)
ChatGPT invents false court precedents
Another case is very contemporary. In 2023, lawyer Steven A. Schwartz used ChatGPT to find past legal cases for a lawsuit against the airline Avianca. However, it turned out that at least six of the cases provided by AI were false – they contained incorrect names, case numbers, and citations.
This happened because Large Language Models (LLM) hallucinate, i.e. they create probable answers when they can’t find the right facts. Therefore it is necessary to check their answers every time. And Schwartz skipped this step. That’s why the judge fined him $5,000 for “gross negligence”.
Business mishaps: Apple Watch which doesn’t work properly on people with darker skin
According to a 2021 class action lawsuit, the blood oxygen app on Apple Watch does not work properly for people with darker skin tones. Apple asserts that it has tested the app on a “wide range of skin types and tones,” but critics say the technology devices are still not designed with dark-skinned people in mind.
Source: DALL·E 3, prompt: Marta M. Kania (https://www.linkedin.com/in/martamatyldakania/)
Zillow in real estate
Zillow, a real estate company, launched Zillow Offers Zillow, a program to buy homes and quickly resell them, in 2018. CNN reported that Zillow had bought 27,000 homes since its launch in April 2018, but had only sold 17,000 by the end of September 2021. Zillow said the business mishap was caused by its use of artificial intelligence. The algorithm incorrectly predicted home prices, causing Zillow to overpay for purchases. Although the company immediately shut down the program, it had to lay off 25 percent of its staff. By unintentionally buying homes at prices higher than current estimates of future sale prices, the company recorded a $304 million loss.
Microsoft’s racist chatbot
In 2016, Microsoft released an experimental AI chatbot called Tay. It was supposed to learn by interacting with Twitter (now X) users. Within 16 hours, Tay “learned” to post offensive, racist, and sexist tweets. Twitter users deliberately provoked the bot, which did not have the proper safety mechanisms used in chatbots today, such as ChatGPT, Microsoft Copilot, and Google Bard. Microsoft quickly disabled the bot and apologized for the incident, but Tay is one of Microsoft’s bigger business mishaps.
A chatbot mishap also happened to Google, which released a bot named Meena in 2020. Meta (formerly Facebook) also failed to avoid a similar mistake. In August 2022, it launched a new AI chatbot called BlenderBot 3, which was designed to chat with people and learn from those interactions.
Within days of its release, there were reports of the chatbot making offensive, racist, and factually incorrect statements in conversations. For example, it claimed that Donald Trump won the 2020 U.S. election, spread anti-Semitic conspiracy theories, and criticized Facebook.
If you like our content, join our busy bees community on Facebook, Twitter, LinkedIn, Instagram, YouTube, Pinterest, TikTok.
Author: Robert Whitney
JavaScript expert and instructor who coaches IT departments. His main goal is to up-level team productivity by teaching others how to effectively cooperate while coding.
AI in business:
- Threats and opportunities of AI in business (part 1)
- Threats and opportunities of AI in business (part 2)
- AI applications in business - overview
- AI-assisted text chatbots
- Business NLP today and tomorrow
- The role of AI in business decision-making
- Scheduling social media posts. How can AI help?
- Automated social media posts
- New services and products operating with AI
- What are the weaknesses of my business idea? A brainstorming session with ChatGPT
- Using ChatGPT in business
- Synthetic actors. Top 3 AI video generators
- 3 useful AI graphic design tools. Generative AI in business
- 3 awesome AI writers you must try out today
- Exploring the power of AI in music creation
- Navigating new business opportunities with ChatGPT-4
- AI tools for the manager
- 6 awesome ChatGTP plugins that will make your life easier
- 3 grafików AI. Generatywna sztuczna inteligencja dla biznesu
- What is the future of AI according to McKinsey Global Institute?
- Artificial intelligence in business - Introduction
- What is NLP, or natural language processing in business
- Automatic document processing
- Google Translate vs DeepL. 5 applications of machine translation for business
- The operation and business applications of voicebots
- Virtual assistant technology, or how to talk to AI?
- What is Business Intelligence?
- Will artificial intelligence replace business analysts?
- How can artificial intelligence help with BPM?
- AI and social media – what do they say about us?
- Artificial intelligence in content management
- Creative AI of today and tomorrow
- Multimodal AI and its applications in business
- New interactions. How is AI changing the way we operate devices?
- RPA and APIs in a digital company
- The future job market and upcoming professions
- AI in EdTech. 3 examples of companies that used the potential of artificial intelligence
- Artificial intelligence and the environment. 3 AI solutions to help you build a sustainable business
- AI content detectors. Are they worth it?
- ChatGPT vs Bard vs Bing. Which AI chatbot is leading the race?
- Is chatbot AI a competitor to Google search?
- Effective ChatGPT Prompts for HR and Recruitment
- Prompt engineering. What does a prompt engineer do?
- AI Mockup generator. Top 4 tools
- AI and what else? Top technology trends for business in 2024
- AI and business ethics. Why you should invest in ethical solutions
- Meta AI. What should you know about Facebook and Instagram's AI-supported features?
- AI regulation. What do you need to know as an entrepreneur?
- 5 new uses of AI in business
- AI products and projects - how are they different from others?
- AI-assisted process automation. Where to start?
- How do you match an AI solution to a business problem?
- AI as an expert on your team
- AI team vs. division of roles
- How to choose a career field in AI?
- Is it always worth it to add artificial intelligence to the product development process?
- AI in HR: How recruitment automation affects HR and team development
- 6 most interesting AI tools in 2023
- 6 biggest business mishaps caused by AI
- What is the company's AI maturity analysis?
- AI for B2B personalization
- ChatGPT use cases. 18 examples of how to improve your business with ChatGPT in 2024
- Microlearning. A quick way to get new skills
- The most interesting AI implementations in companies in 2024
- What do artificial intelligence specialists do?
- What challenges does the AI project bring?
- Top 8 AI tools for business in 2024
- AI in CRM. What does AI change in CRM tools?
- The UE AI Act. How does Europe regulate the use of artificial intelligence
- Sora. How will realistic videos from OpenAI change business?
- Top 7 AI website builders
- No-code tools and AI innovations
- How much does using AI increase the productivity of your team?
- How to use ChatGTP for market research?
- How to broaden the reach of your AI marketing campaign?
- "We are all developers". How can citizen developers help your company?
- AI in transportation and logistics
- What business pain points can AI fix?
- Artificial intelligence in the media
- AI in banking and finance. Stripe, Monzo, and Grab
- AI in the travel industry
- How AI is fostering the birth of new technologies
- The revolution of AI in social media
- AI in e-commerce. Overview of global leaders
- Top 4 AI image creation tools
- Top 5 AI tools for data analysis
- AI strategy in your company - how to build it?
- Best AI courses – 6 awesome recommendations
- Optimizing social media listening with AI tools
- IoT + AI, or how to reduce energy costs in a company
- AI in logistics. 5 best tools
- GPT Store – an overview of the most interesting GPTs for business
- LLM, GPT, RAG... What do AI acronyms mean?
- AI robots – the future or present of business?
- What is the cost of implementing AI in a company?
- How can AI help in a freelancer’s career?
- Automating work and increasing productivity. A guide to AI for freelancers
- AI for startups – best tools
- Building a website with AI
- OpenAI, Midjourney, Anthropic, Hugging Face. Who is who in the world of AI?
- Eleven Labs and what else? The most promising AI startups
- Synthetic data and its importance for the development of your business
- Top AI search engines. Where to look for AI tools?
- Video AI. The latest AI video generators
- AI for managers. How AI can make your job easier
- What’s new in Google Gemini? Everything you need to know
- AI in Poland. Companies, meetings, and conferences
- AI calendar. How to optimize your time in a company?
- AI and the future of work. How to prepare your business for change?
- AI voice cloning for business. How to create personalized voice messages with AI?
- Fact-checking and AI hallucinations
- AI in recruitment – developing recruitment materials step-by-step
- Midjourney v6. Innovations in AI image generation
- AI in SMEs. How can SMEs compete with giants using AI?
- How is AI changing influencer marketing?
- Is AI really a threat to developers? Devin and Microsoft AutoDev
- AI chatbots for e-commerce. Case studies
- Best AI chatbots for ecommerce. Platforms
- How to stay on top of what's going on in the AI world?
- Taming AI. How to take the first steps to apply AI in your business?
- Perplexity, Bing Copilot, or You.com? Comparing AI search engines
- ReALM. A groundbreaking language model from Apple?
- AI experts in Poland
- Google Genie — a generative AI model that creates fully interactive worlds from images
- Automation or augmentation? Two approaches to AI in a company
- LLMOps, or how to effectively manage language models in an organization
- AI video generation. New horizons in video content production for businesses
- Best AI transcription tools. How to transform long recordings into concise summaries?
- Sentiment analysis with AI. How does it help drive change in business?
- The role of AI in content moderation
