We are all familiar with the benefits of Generative AI (GAI) chatbots such as ChatGPT, which have made our daily work much easier. Currently, only tech enthusiasts and experts use GAI tools. However, to make it more accessible to a larger section of society, many countries are competing to develop their own locally-built Large Language Models (LLM) that the GAI chatbots like ChatGPT use. Let’s look at what is happening in India concerning GAI.
Brief Introduction to Indian Generative AI
Several large companies and over 60 startups in India are developing Generative AI apps like JanAI, AI4Bharat, BharatGPT, and many others for various industries. GAI needs Large Language Models (LLM) to process and give the output. However, the elephant in the room is LLM which encapsulates datasets about Indian languages and their dialects, the economy, and cultural variance across the length and breadth of India. LLMs are very costly to build as they require a deep pocket to fund them, let’s see why.
Large Language Models (LLM)
What are LLMs? – A large language model (LLM) is a type of machine learning model that is capable of performing various natural language processing (NLP) tasks. These tasks include generating and classifying text, conversationally answering questions, and translating text from one language to another. The term “large” refers to the number of autonomous values (parameters) the language model can change as it learns. Some of the most successful LLMs have hundreds of billions of parameters.
How does it do? – Large Language Models (LLMs) are trained using massive amounts of data. They use self-supervised learning techniques to predict the next word in a sentence, based on the context around it. This process is repeated several times until the model achieves an acceptable level of accuracy.
What different tasks does LLM do? – Once an LLM has been trained, it can be fine-tuned for a wide range of Natural Language Processing (NLP) tasks, including:
- Building conversational chatbots like ChatGPT.
- Generating text for product descriptions, blog posts, and articles.
- Answering frequently asked questions (FAQs) and routing customer inquiries to the most appropriate human.
- Analyzing customer feedback from emails, social media posts, and product reviews.
- Translating business content into different languages.
- Classifying and categorizing large amounts of text data for more efficient processing and analysis.
Who is building LLMs in India?
Reliance – Nvidia, an American chipmaker, and Reliance Industries, India’s largest company by market capitalization, have announced a collaboration to build a large language model (LLM) using artificial intelligence algorithms. The LLM will be trained in various Indic languages, which India’s 1.4 billion citizens speak. The company also intends to invest in creating 2000MW of AI-ready computing capacity.
Tech Mahindra – Tech Mahindra has recently announced ‘Project Indus’, an indigenous large language model (LLM) that aims to support multiple languages. The model will initially focus on covering 40 Hindi dialects, and people can contribute to it by lending their voices via specific prompts. The goal of the project is to create a comprehensive language model that can be used for various applications and industries.
Government – BhashiniAI – It is the Government’s promoted “Open Source” solution based on AI and Natural Language Processing (NLP) that aims to bridge the language barrier in communication. The AI-enabled translation tool can translate 22 languages.
Tata group – Tata Telecommunications and Nvidia have tied up to build Generative AI apps, and LLMs together and host them on Nvidia’s advanced AI-enabled supercomputer to help host GAIs built by startups.
India ranks 5th among countries with the most AI investment
India was ranked fifth for AI-based startup investments in 2020, according to Stanford University’s AI Index report.
In 2022, AI startups in India received a total of $3.24 billion in investments, which places India ahead of countries such as South Korea, Germany, Canada, and Australia. However, the countries ahead of India on the list are the US, China, and the UK. India and Israel got similar kinds of investment in 2022, that is USD 3.24 billion.
India’s big jump into the development of desi LLMs
Till 2021, the Stanford report said 54% of researchers working on large language models (LLMs) were from American institutions. However, in 2022 researchers from Canada, Germany, and India contributed to the development of LLMs for the first time in history.
Indian Generative AI market size
As per Indiaai, a government’s latest report, India’s Generative AI market software market will grow from USD 2.76 million in 2020 to USD 6.35 billion in 2025, at a CAGR of 18.1%. The article quotes “According to the latest report by the International Data Corporation (IDC), the Artificial Intelligence (AI) market in India is expected to reach USD 7.8 billion by 2025. It is growing at a Compound Annual Growth Rate (CAGR) of 20.2% from its current market value of USD 3.1 billion in 2020.
The AI services market is set to lead the overall AI market growth in India by 2025, growing at a CAGR of 35.8%. Additionally, the IDC report predicts that the AI software market in India will grow from USD 2.76 billion in 2020 to USD 6.35 billion by 2025, at a CAGR of 18.1%. This indicates a promising growth potential for the AI industry in India.” India’s Generative AI market is at the cusp of taking off.
India Ranked 1 in AI Skill & Talent Among All OECD and G20 Countries
As per AnalyticsVidhya guys, Artificial Intelligence (AI) has emerged as a crucial skill in the ever-evolving landscape of technology. India, with its massive tech workforce, has taken the lead in the race for AI skills. The country’s tech-savvy professionals are embracing AI technology like no one else. By this they are driving innovation across various industries, reshaping their careers in the process. A report by the National Association of Software and Services Companies (Nasscom) highlights India’s leadership role in the AI domain. It ranks India first in AI skill penetration and concentration of AI talent among all OECD and G20 countries.
India’s AI Skills Boom – a Surprise
Generative AI becoming more mainstream has led to a surge in skills enhancement. Since January 2016, the number of Indians adding AI skills to their LinkedIn profiles has increased by an astounding 14x. This surge highlights the growing importance of AI in today’s professional world.
India is a tech powerhouse with a tech-savvy workforce of 4.7 million professionals. However, despite having a substantial talent pool, India is facing a pressing issue – a scarcity of AI experts. The demand for AI skills has skyrocketed, demonstrating the transformative power of AI in various sectors. The full report can be read Here
Indian Desi Generative AI is a prime example of India’s innovative spirit and adaptability. It embraces the country’s linguistic, cultural, and economic diversity and leverages AI to tackle unique challenges in various sectors.
The impact of this technology is not limited to India, but it has the potential to influence AI development globally. As Indian Desi Generative AI continues to evolve, it promises to bring about a technological revolution that empowers, uplifts, and connects people across the nation and beyond.