Hugging Face's logo
Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity
mohit-raghavendra  new activity about 8 hours ago
ScaleAI/SWE-Atlas-QnA:Criterion Granularity Mismatch in Rubric (Example: Task 6905333b74f22949d97ba9f1, Criterion 1.11)
andrewpark-scaleai  updated a dataset about 8 hours ago
ScaleAI/SWE-Atlas-QnA
andrewpark-scaleai  new activity about 9 hours ago
ScaleAI/SWE-Atlas-QnA:cannot pull images from today
View all activity

Papers

Agentic Rubrics as Contextual Verifiers for SWE Agents

ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents

View all Papers
mohit-raghavendra 
in ScaleAI/SWE-Atlas-QnA about 8 hours ago

Criterion Granularity Mismatch in Rubric (Example: Task 6905333b74f22949d97ba9f1, Criterion 1.11)

1
#2 opened 19 days ago by
OceaneLL
andrewpark-scaleai 
updated a dataset about 8 hours ago
andrewpark-scaleai 
in ScaleAI/SWE-Atlas-QnA about 9 hours ago

cannot pull images from today

1
#4 opened 4 days ago by
wang-ming
mohit-raghavendra 
updated a dataset about 17 hours ago
georgethep1 
updated a dataset 11 days ago
mohit-raghavendra 
published a dataset 27 days ago
jda 
in ScaleAI/SWE-bench_Pro about 1 month ago

image-name mismatch

1
#3 opened 6 months ago by
congfengyin
anisha2102 
updated 2 datasets about 1 month ago
anisha2102 
updated a collection about 1 month ago
anisha2102 
published a dataset about 1 month ago
anisha2102 
updated a collection about 1 month ago
anisha2102 
published a dataset about 1 month ago
jda 
in ScaleAI/SWE-bench_Pro about 1 month ago

Add eval.yaml
#4 opened about 1 month ago by
nielsr
kalescale 
updated a dataset about 1 month ago
agosai 
updated a dataset about 1 month ago
georgethep1 
published a dataset about 2 months ago
jda 
updated a dataset about 2 months ago
agosai 
in ScaleAI/audiomc about 2 months ago

Incorrect transcript for klvkcs0dggmesj0i, user turn 5

1
#1 opened about 2 months ago by
lematt1991
utkarsh4430 
updated a dataset 2 months ago