DataScaleFail #9 - Benchmarking Vector Databases, Time-series databases, and a New Custom Benchmark
- BenchANT
- Apr 24, 2024
- 1 min read
AI is currently the hype topic par excellence and in the database world the corresponding Vector databases of course. We have taken a look at the benchmarking rules of these VectorDBs.
Have fun reading!
Vector Database Benchmarking
![[Section 1 image alt text]](https://static.wixstatic.com/media/387f15_5cb67d700551401198580d696389ab6b~mv2.webp/v1/fill/w_849,h_845,al_c,q_85,enc_avif,quality_auto/387f15_5cb67d700551401198580d696389ab6b~mv2.webp)
First VectorDB benchmarking suites available
4 out of 13 VectorDB forbid benchmarking
Performance might be questionable
Time-Series Benchmarking Suites
![[Section 2 image alt text]](https://static.wixstatic.com/media/387f15_f6d052a5a6de4f7484ffec0ac87da202~mv2.png/v1/fill/w_980,h_980,al_c,q_90,usm_0.66_1.00_0.01,enc_avif,quality_auto/387f15_f6d052a5a6de4f7484ffec0ac87da202~mv2.png)
Telegraf is a popular monitoring solution with many different data backends
Telegraf-TS is an extension to YCSB to evaluate different types of analytical queries over Telegraf data
This tailored workload helps with decision making for this very specific scenario
Time-Series Benchmarking Suites
![[Section 3 image alt text]](https://static.wixstatic.com/media/387f15_99d7b6b4546746438161f39167269926~mv2.png/v1/fill/w_980,h_264,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/387f15_99d7b6b4546746438161f39167269926~mv2.png)
Continued research with 7 good-to-know time-series benchmarking suites
Mapped IoT, monitroing and logging use cases
VectorDB benchmarking suites will follow next time
More?
You found this interesting and you want more? Checkout the previous edition or try our archive with all previous and future issues of the newsletter. Checking archives is not what you want? You prefer getting new content directly to your mailbox? Then subscribe.
Comments