28 points | by boyter 4 days ago
1 comments
Regarding LOCOMO I have a fork that calculates an estimate based on # of commits * price per task according to Artificial Analysis benchmarks for a given model, and includes a simple overhead multiplier to pad out the estimate.
Regarding LOCOMO I have a fork that calculates an estimate based on # of commits * price per task according to Artificial Analysis benchmarks for a given model, and includes a simple overhead multiplier to pad out the estimate.