Chris Greer did an interview/video where at the end he covered how he filters and merges a ton of data. Skip to the 1 hour mark for that section specifically.
https://youtu.be/ObUgYDn1zZ0?si=wk2BPpooSKqj1iTN