A Generative AI Engineer is evaluating LSH (Locality Sensitive Hashing) and HNSW (Hierarchical Navigable Small World) for indexing a vector database, with semantic accuracy as the primary concern.

Which method should be used to compare these two indexing techniques?

Exam-Like

Compare the cosine similarities of the embeddings of returned results against those of a representative sample of test inputs

60.7%

Compare the Bilingual Evaluation Understudy (BLEU) scores of returned results for a representative sample of test inputs

9.3%

Compare the Recall-Oriented-Understudy for Gisting Evaluation (ROUGE) scores of returned results for a representative sample of test inputs

16.8%

Compare the Levenshtein distances of returned results against a representative sample of test inputs

13.1%

Databricks Certified Generative AI Engineer - Associate