How to Evaluate an AI Service Provider

This podcast session highlights some creative ways AI has been used inside corporations and law firms.
 

Questions Ryan asked the speaker:

1. Are there any specific examples of you using AI outside of the box that you would use as an example for people who are not sure if AI is useful for their project?
2. What are the differences between AI and Machine Learning?
3. Large language models: what do they actually do, how can we use them, and are there compliance risks? How do we evaluate LLM output and make sure we're getting something useful back?
4. Specific versus general: what are the ways we can think about point (specific, non-generalized) AI solutions versus generalized (e.g., GPT-4) solutions? What are the trade-offs between these approaches?
5. Do you need fancy data scientists and software? (Spoiler, no, you don't)
6. How do you evaluate an AI services provider/partner?
   
   Moderator:
   @Ryan Gerlach - Legal Analyst, State of California Office of the Attorney General - DOJ   Speaker: Andy Ward, - Vice President, Machine Learning, Laurel Inc.  

   
   Recorded on 04-18-2023