Data Skeptic Analysis of Unstructured Data
Jun 28, 2024
Robbie Moon from Georgia Tech discusses analyzing unstructured financial data, using NLP for market predictions, challenges of dealing with unclean data, evolution of text analysis in trading, and the program's flexible course offerings for participants with varying backgrounds.
AI Snips
Chapters
Transcript
Episode notes
Accounting as Market Information
- Financial accounting research treats accounting as information influencing market outcomes like trading and earnings reports.
- Textual data from disclosures and social media platforms enriches this information landscape for analysis.
Clean Textual Data Diligently
- Clean and preprocess noisy textual data carefully to avoid spurious results.
- Understand if noise is random or non-random to interpret your regression outcomes correctly.
NLP Techniques for Finance Text
- Use NLP techniques like word counts and financial dictionaries to analyze tone in financial texts.
- Employ vectorization and machine learning classifiers to capture semantic relationships beyond simple word counts.