I think that isn't really built for large datasets. I had a buddy who used it a lot on smaller web sites though. I'm way out of date and this stuff might be horribly old fashioned. Vector search is the new hotness but on the other hand, search systems everywhere are getting worse, so who knows.
https://xapian.org/docs/bm25.html
https://getting-started-with-xapian.readthedocs.io/en/latest...