P3: AI Programming Puzzles in Python for Algorithm Synthesis

We introduce a new type of programming challenge called programming puzzles,
as an objective and comprehensive evaluation of program synthesis, and release
an open-source dataset of Python Programming Puzzles (P3). Each puzzle is
defined by a short Python… Read more

Similar