Autoresearch for SAT Solvers

(github.com)

95 points | by chaisan 6 hours ago

8 comments

  • stefanpie 4 hours ago
    Prof. Cunxi Yu and his students at UMD is working on this exact topic and published a paper on agents for improving SAT solvers [1].

    I believe they are extending this idea to EDA / chip design tools and algorithms which are also computationally challenging to solve. They have an accepted paper on this for logic synthesis which will come out soon.

    [1] "Autonomous Code Evolution Meets NP-Completeness", https://arxiv.org/abs/2509.07367

    • chaisan 3 hours ago
      nice. EDA indeed one of the top applications of SAT
  • ericpauley 4 hours ago
    It should be noted that MaxSAT 2024 did not include z3, as with many competitions. It’s possible (I’d argue likely) that the agent picked up on techniques from Z3 or some other non-competing solver, rather than actually discovering some novel approach.
    • dooglius 3 hours ago
      Is z3 competitive in SAT competitions? My impression was that it is popular due to the theories, the python API, and the level of support from MSR.
      • ericpauley 2 hours ago
        Funnily, this was precisely the question I had after posting this (and the topic of an LLM disagreement discussed in another thread). Turns out not, but sibling comment is another confounding factor.
    • jmalicki 4 hours ago
      Or for that matter even from later versions of the same solvers that were in its training data!
      • ericpauley 4 hours ago
        True. I’d be curious whether a combination of matching comp/training cutoff and censoring web searches could yield a more precise evaluation.
        • chaisan 2 hours ago
          as its from 2024 (MaxSAT was not held in 2025), its quite likely all the solvers are in the training data. so the interesting part here is the instances for which we actually got better costs that what is currently known (in the best-cost.csv) file.
  • MrToadMan 1 hour ago
    Not as many changes to the files under library as I expected to see. Most changes seemed to be under a single ‘add stuff’ commit. If some of the solvers are randomised, then repeatedly running and recording best solution found will continually improve over time and give the illusion of the agent making algorithmic advancements, won’t it?
    • chaisan 5 minutes ago
      yeh. ofc. but on any problem larger than 40 variables, the gains from random restarts or initializations will quickly plateau
      • chaisan 4 minutes ago
        and it would take an algo change to the solver to jump to the next local optimum
  • cerved 27 minutes ago
    Would me be nice to try this on lcg (CP-SAT) solvers
  • gsnedders 4 hours ago
    What counts as “our cost”? How long it takes to find the MaxSAT?
    • chaisan 2 hours ago
      the sum of the weights of the unsatistied clauses. we want to reduce this number
  • ktimespi 2 hours ago
    sounds like AlphaDev [1] might be a better approach for a problem like this.

    [1] https://github.com/google-deepmind/alphadev

  • ClawVorpal21355 1 hour ago
    anyone else finding that agent architectures are way more expensive than expected?
    • chaisan 3 minutes ago
      wrt. token usage?
  • balinha_8864 3 hours ago
    [dead]
    • chaisan 2 hours ago
      its just comparing the cost of the best solution found to the best known cost we had before. O(N). why optimistic?