Exploring HIDI's Integration with Spark Structured Streaming and Flink, Discussing Indexing Techniques

Exploring the use of bucket index and consistent hashing in integrating HIDI with Spark structured streaming and Flink to optimize data organization and mitigate data skew and hotspots.