Code for Thought cover image

[EN] Test Driven Data Analysis - with Nick Radcliffe

Code for Thought

The Importance of Interpretation in Machine Learning

2min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

I think interpretation is the hardest part. And I think it's the part we've got least far with developing. But it is super important. It's almost like part of the Hippocratic oath for data scientists ought to be, we're not going to say it's your fault if you interpret my beautiful output wrongly. So there's lots that we can do by hand. We can label things clearly. We can write out sentences. We can highlight things. We can have. You'll see on a lot of graphs these days, people actually write, more is better.

Nick Radcliffe, data scientist and entrepreneur, talks to us about the importance of test your data. As software engineers we are familiar with test driven development. Test driven data analysis puts the same emphasis on validating and testing data for your AI app. We also dive into the Python library of the same name tdda.

Links:

https://linkedin.com/in/njradcliffe LinkedIn profile Nick Radcliffe
http://www.tdda.info Test Driven Data Analysis Blog
https://tdda.readthedocs.io/en/latest/ tdda library documentation
https://github.com/tdda/tdda TDDA GitHub repo
https://smartdatafoundry.com/ Smart Data Foundry
https://stochasticsolutions.com Stochastic Solutions - also contains links to papers and publications by Nick Radcliffe

Other libraries mentioned:

https://www.evidentlyai.com Evidently AI
https://greatexpectations.io Great Expectations

Don't forget the upcoming RSE conferences and the Hidden Ref event

https://rsecon23.society-rse.org UK RSE Conference in Swansea 5-8 September 2023
https://hidden-ref.org/festival-of-hidden-ref/ The Hidden Ref Festival, Bristol 21 September
https://un-derse23.sciencesconf.org deRSE Unconference in Jena, Germany, 26 - 28 September
https://us-rse.org/usrse23/ US RSE Conference in Chicago, USA, 16-18 October

Support the show

Thank you for listening! Merci de votre écoute! Vielen Dank für´s Zuhören!

Contact Details/ Coordonnées / Kontakt:

Email mailto:code4thought@proton.me
UK RSE Slack (ukrse.slack.com): @code4thought or @piddie
US RSE Slack (usrse.slack.com): @Peter Schmidt
Mastodon: https://fosstodon.org/@code4thought or @code4thought@fosstodon.org
LinkedIn: https://www.linkedin.com/in/pweschmidt/ (personal Profile)
- LinkedIn: https://www.linkedin.com/company/codeforthought/ (Code for Thought Profile)

This podcast is licensed under the Creative Commons Licence: https://creativecommons.org/licenses/by-sa/4.0/

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

App store banner

Play store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode