Team Ai
Datasetpublic

sharkiefff/RBAC-Text2SQL-Benchmark

RBAC-Text2SQL Benchmark Role-conditioned Text-to-SQL instances for evaluating whether LLMs generate SQL that respects Role-Based Access Control (RBAC) constraints. Each instance pairs a natural language question with a role policy; the model must either produce a correct SQL query that touches only authorized resources, or refuse with Sorry, I cannot answer. Code, evaluation harness, and reproduction instructions: https://github.com/2020dfff/RBAC-Text2SQL-Benchmark… See the full description on the dataset page: https://huggingface.co/datasets/sharkiefff/RBAC-Text2SQL-Benchmark.

sourceHugging Facecc-by-4.0updated 2mo agoView on Hugging Face
1likes180downloads
4 commits on main
31309592mo ago

Update README.md

sharkiefff
c3cafbe3mo ago

docs: citation placeholder pending arXiv release

sharkiefff
ac5c4ae3mo ago

RBAC-Text2SQL benchmark v3 (LiveSQLBench GT redacted per upstream access policy)

sharkiefff
bce48a23mo ago

initial commit

sharkiefff