Clariant Builds Generative AI Foundation to Improve Productivity with Help from Chaos Gears on AWS

Clariant immediately saw many potential uses cases for Generative AI after ChatGPT’s public launch. With over 1,500 chemical products across two dozen industries, Clariant manages large amounts of data that could offer insights for researchers, salespeople, and others in the business. It also believed that a chatbot trained on its internal organizational data could be useful for its 10,000-plus employees.

“The initial idea we came up with was research and development, where we have a lot of scientific papers that we have to search through and analyze,” says Ariel Syrko, IT manager, cloud architects, at Clariant. “But there are plenty of other use cases, like for IT, where there is a lot of documentation for the help desk and user self-service.” Another motivation for the project, he adds, was to ensure that employees who wanted to use Generative AI would have a secure sandbox based on Clariant’s internal data, rather than feeding proprietary—or even confidential—data into a public tool like ChatGPT.

The timing for the project was also right because Clariant had completed a global migration of its IT infrastructure to AWS in 2022, setting up processes, standards, and a skilled internal team for cloud architecture and engineering. The migration gave Clariant new cloud capabilities, meaning that it could easily use the many AWS products and services related to machine learning (ML) and AI. To make the most of those capabilities, Clariant knew it would need support from a vendor with experience with both AWS and AI/ML, so it turned to Chaos Gears, which it had worked with on other projects over the previous couple of years.

“I knew they had good specialists in the area of cloud and machine learning,” says Syrko. “We had received very good support in different areas of engineering, and that’s how we ended up working with them on generative AI as well.”
 

Working remotely with Clariant, Chaos Gears began the project by assessing what the company’s goals were and what cloud architecture standards it had worked out to that point. Clariant’s architecture and engineering team had already created a Generative AI architecture framework and prototype for an AI chatbot, so Chaos Gears started building a platform that would serve as the foundation for that and for any other tools that Clariant decided to roll out later. The goal was to create a solid base that could be easily adapted to multiple Generative AI applications using modular building blocks. Chaos Gears also trained Clariant’s team to further build their in-house Generative AI skills.

One of the biggest challenges was to review and, where necessary, enrich data sources that would be used to generate Generative AI responses, says Tomasz Dudek, data and AI team lead and solutions architect for Chaos Gears.

“There’s a lot of data and it varies in quality,” says Dudek. “You need to spend a lot of time filtering to improve and enrich its quality. Also, some companies have data from 10 years ago that’s no longer relevant. That’s the main challenge around data in literally every project.”

Rather than training a custom large language model (LLM) from the ground up, Clariant and Chaos Gears used retrieval-augmented generation (RAG) on Amazon Bedrock to build the solution. A managed service that offers a choice of high-performing foundation models (FMs), Amazon Bedrock lets companies customize responses to Generative AI queries by using RAG to first search their databases for the most relevant information. It then uses the LLM to produce human-readable answers based on that information.

“You don’t expect the model to know your company, but you expect it to understand the language to know how to extract knowledge out of text,” says Dudek. “So instead of training a model, after a user asks a question, you find relevant documents in the database, provide that to the model, and tell the model, ‘This is the knowledge you need to have in order to answer this question.’”

In less than 3 months, Clariant had a working Generative AI platform in place. It then rolled out the first tool—an internal chatbot that works much like ChatGPT—to about 1,000 employees across the organization. Working with Chaos Gears and AWS, it continues to develop that tool, adding new features and functionalities. It’s also working on proofs of concept for other tools to support both the R&D and sales teams.