With today’s digital technology, we can collect and analyze more data than ever before. But how is it possible to sift through the endless data to make connections, see the big picture, and find meaningful insights?
Enter artificial intelligence (AI).
By making routine processes much more efficient, AI brings high value to our working and everyday lives. However, the effectiveness of AI technology heavily relies on the foundation of human expertise. It is the insights and ethical considerations of skilled professionals that guide AI to operate not only effectively but also responsibly. AI algorithms, while capable of learning and adapting to individual needs by recognizing behavior patterns and customizing solutions, require careful design and continuous human oversight to ensure they serve the greater good and avoid unintended consequences.
Keep reading to explore the critical role of human touch in the development of AI.
The Thomson Reuters AI legacy
We have uniquely positioned ourselves to bring together effective AI solutions. Over time, we have identified three vital ingredients that distinguish the strength of our AI: technology, content, and human expertise.
With over a century of experience in curating and classifying rich datasets in legal, tax, and other professional fields, we recognized early on — beginning in the early 1990s — the distinctive capabilities of AI and machine learning to provide quick and reliable guidance, continually leveraging technological advances to enhance professional access to information. None of that is possible without human expertise.
Human touch is essential to reliable AI
Our experts are the critical underpinning to our best-in-class solutions. Our technical experts do the heavy lifting of developing our AI technology, training our data for machine-learning systems, developing search and question-and-answer systems, and creating deep-learning modules to solve complex problems.
In tandem, our domain experts supply the industry background — bringing their domain knowledge and understanding of our customers’ workflow, nuances, and daily challenges into the core of our solutions. Because we invest in this combined expertise, we can ensure that our solutions deliver accurate and thoughtful knowledge to our customers.
According to the latest Future of Professionals report, almost two-thirds of respondents believe a “human in the loop” approach is critical for responsible AI use.
Over time, our experts have developed AI technologies that streamline searches and make them more valuable and intuitive, automate processes, find information that traditional research may have missed, and gain data-driven insights.
CoCounsel’s human expertise
The recent advancements in generative AI (GenAI) technology present an unparalleled opportunity to revolutionize how our products interact across the industries we serve. This development enables our customers to confidently integrate the capabilities of GenAI into their daily workflows.
Our professional-grade GenAI assistant, CoCounsel, is backed by 2,500 know-how experts and engineered by over 4,500 AI experts. It provides a single, secure, human-centric chat interface equipped to conduct in-depth research, analyze extensive and complex data, and generate diverse types of content quickly.
CoCounsel’s process for ensuring reliable, trustworthy results involves three distinct levels of human testing.
Model testing
This process begins with the first phase: testing each new model discovered against a suite of tests created by experts. These tests ascertain the model's ability to reason and perform tasks based on a mix of both publicly available and Thomson Reuters legal benchmarks. These tests validate at the basic level how capable this model is of completing reasoning tasks.
Individual request testing
The second phase involves testing individual requests or tasks and evaluating their quality using prompt engineering. CoCounsel's prompt engineers and the Trust Team have worked together to create hundreds or even thousands of specific prompt-level test cases with known accurate answers to those tests. These teams validate that the model answers match against the known good answers.
Prompt engineers
“Our team of prompt engineers have a very unique background,” says Ryan Walker, Vice President of Technology at Thomson Reuters. “They are all attorneys who also have a background in software engineering, which gives them the expertise to test the prompts and assess the quality of the answers they receive. Even when you get to the engineering layers of CoCounsel, the domain expertise is embedded. Which is critical to building this type of technology.”
The Trust Team
The Trust Team are full-time attorneys whose focus is solely on the quality of CoCounsel’s answers. The partnership of prompt engineers with our Trust Team is vital in ensuring the accuracy and reliability of the system.
Skill-level testing
The final testing phase involves end-to-end testing of skills against real use cases. Now that the microprompts have all been tested, the skill is tested holistically. At this stage, experts evaluate the overall quality of the answers generated, and it is confirmed that all the pieces come together correctly and that the end product is a high-quality, accurate response.
