Rue: Higher level than Rust, lower level than Go

(rue-lang.dev)

103 points | by ingve 6 hours ago

14 comments

  • est31 21 minutes ago
    I have mostly been writing Rust in the last 10 years, but recently (1 year) I have been writing Go as well as Rust.

    The typical Go story is to use a bunch of auto generation, so a small change quickly blows up as all of the auto generate code is checked into git. Like easily a 20x blowup.

    Rust on the other hand probably does much more such code generation (build.rs for stuff like bindgen, macros for stuff like serde, and monomorphized generics for basically everything). But all of this code is never checked into git (with the exception of some build.rs tools which can be configured to run as commands as well), or at least 99% of the time it's not.

    This difference has impact on the developer story. In go land, you need to manually invoke the auto generator and it's easy to forget until CI reminds you. The auto generator is usually quite slow, and probably has much less caching smartness than the Rust people have figured out.

    In Rust land, the auto generation can, worst case, run at every build, best case the many cache systems take care of it (cargo level, rustc level). But still, everyone who does a git pull has to re-run this, while with the auto generation one can theoretically only have the folks run it who actually made changes that changed the auto generated code, everyone else gets it via git pull.

    So in Go, your IDE is ready to go immediately after git pull and doesn't have to compile a tree of hundreds of dependencies. Go IDEs and compilers are so fast, it's almost like cheating from Rust POV. Rust IDEs are not as fast at all even if everything is cached, and in the worst case you have to wait a long long time.

    On the other hand, these auto generation tools in Go are only somewhat standardized, you don't have a central tool that takes care of things (or at least I'm not aware of it). In Rust land, cargo creates some level of standardization.

    You can always look at the auto generated Go code and understand it, while Rust's auto generated code usually is not IDE inspectable and needs special tools for access (except for the build.rs generated stuff which is usually put inside the target directory).

    I wonder how a language that is designed from scratch would approach auto generation.

    • Kinrany 18 minutes ago
      FYI rust-analyzer can show expanded macros. It's not perfect because you only get syntax highlighting, but it works.
  • killingtime74 5 hours ago
    I always thought of Go as low level and Rust as high level. Go has a lot of verbosity as a "better C" with GC. Rust has low level control but many functional inspired abstractions. Just try writing iteration or error handling in either one to see.
    • gpm 4 hours ago
      I wonder if it's useful to think of this as go is low type-system-complexity and rust is high type-system-complexity. Where type system complexity entails a tradeoff between the complexity of the language and how powerful the language is in allowing you to define abstractions.

      As an independent axis from close to the underlying machine/far away from the underlying machine (whether virtual like wasm or real like a systemv x86_64 abi), which describes how closely the language lets you interact with the environment it runs in/how much it abstracts that environment away in order to provide abstractions.

      Rust lives in high type system complexity and close to the underlying machine environment. Go is low type system complexity and (relative to rust) far from the underlying machine.

      • steveklabnik 3 hours ago
        I think this is insightful! I'm going to ponder it, thank you. I think it may gesture towards what I'm trying to get at.
    • steveklabnik 5 hours ago
      Rue author here, yeah I'm not the hugest fan of "low level vs high level" framing myself, because there are multiple valid ways of interpreting it. As you yourself demonstrate!

      As some of the larger design decisions come into place, I'll find a better way of describing it. Mostly, I am not really trying to compete with C/C++/Rust on speed, but I'm not going to add a GC either. So I'm somewhere in there.

      • written-beyond 4 hours ago
        How very so humble of you to not mention being one of the primary authors behind TRPL book. Steve you're a gem to the world of computing. Always considered you the J. Kenji of the Rust world. Seems like a great project let's see where it goes!
        • steveklabnik 4 hours ago
          That is a very kind thing to say, I admire him quite a bit. Thank you!
      • AdieuToLogic 1 hour ago
        > Mostly, I am not really trying to compete with C/C++/Rust on speed, but I'm not going to add a GC either. So I'm somewhere in there.

        Out of curiosity, how would you compare the goals of Rue with something like D[0] or one of the ML-based languages such as OCaml[1]?

        EDIT:

        This is a genuine language design question regarding an imperative/OOP or declarative/FP focus and is relevant to understanding the memory management philosophy expressed[2]:

          No garbage collector, no manual memory management. A work 
          in progress, though.
        
        
        0 - https://dlang.org/

        1 - https://ocaml.org/

        2 - https://rue-lang.dev/

      • chrysoprace 2 hours ago
        Do you think you'll explore some of the same problem spaces as Rust? Lifetimes and async are both big pain points of Rust for me, so it'd be interesting to see a fresh approach to these problems.

        I couldn't see how long-running memory is handled, is it handled similar to Rust?

        • steveklabnik 1 hour ago
          I'm going to try and avoid lifetimes entirely. They're great in Rust! But I'm going to a higher level spot.

          I'm totally unsure about async.

          Right now there's no heap memory at all. I'll get there :) Sorta similar to Rust/Swift/Hylo... we'll see!

      • ksec 1 hour ago
        Is this a simplified / distilled version of Rust ? Or Subset of Rust with some changes ?
      • manaskarekar 4 hours ago
        Since it's framed as 'in between' Rust and Go, is it trying to target an intersection of both languages' use-cases?
        • steveklabnik 4 hours ago
          I don't think you'd want to write an operating system in Rue. I may not include an "unsafe" concept, and will probably require a runtime. So that's some areas where Rust will make more sense.

          As for Go... I dunno. Go has a strong vision around concurrency, and I just don't have one yet. We'll see.

      • killingtime74 3 hours ago
        Wow didn't realise it was you who was the author. I learnt a lot about Rust from your writings.
    • josephg 3 hours ago
      Yep. This was the biggest thing that turned me off Go. I ported the same little program (some text based operational transform code) to a bunch of languages - JS (+ typescript), C, rust, Go, python, etc. Then compared the experience. How were they to use? How long did the programs end up being? How fast did they run?

      I did C and typescript first. At the time, my C implementation ran about 20x faster than typescript. But the typescript code was only 2/3rds as many lines and much easier to code up. (JS & TS have gotten much faster since then thanks to improvements in V8).

      Rust was the best of all worlds - the code was small, simple and easy to code up like typescript. And it ran just as fast as C. Go was the worst - it was annoying to program (due to a lack of enums). It was horribly verbose. And it still ran slower than rust and C at runtime.

      I understand why Go exists. But I can't think of any reason I'd ever use it.

      • wswin 3 hours ago
        Rust gets harder with codebase size, because of borrow checker. Not to mention most of the communication libraries decided to be async only, which adds another layer of complexity.
        • jrjrjfhgggg 1 hour ago
          Disagree, having dealt with +40k LoC rust projects, bottow checker is not an issue.

          Async is an irritation but not the end of the world ... You can write non asynchronous code I have done it ... Honestly I am coming around on async after years of not liking it... I wish we didn't have function colouring but yeah ... Here we are....

        • gpm 3 hours ago
          I strongly disagree with this take. The borrow checker, and rust in general, keeps reasoning extremely local. It's one of the languages where I've found that difficulty grows the least with codebase size, not the most.

          The borrow checker does make some tasks more complex, without a doubt, because it makes it difficult to express something that might be natural in other languages (things including self referential data structures, for instance). But the extra complexity is generally well scoped to one small component that runs into a constraint, not to the project at large. You work around the constraint locally, and you end up with a public (to the component) API which is as well defined and as clean (and often better defined and cleaner because rust forces you to do so).

        • josephg 2 hours ago
          This hasn't been my experience at all.

          I still regularly use typescript. One problem I run into from time to time is "spooky action at a distance". For example, its quite common to create some object and store references to it in multiple places. After all, the object won't be changed and its often more efficient this way. But later, a design change results in me casually mutating that object, forgetting that its being shared between multiple components. Oops! Now the other part of my code has become invalid in some way. Bugs like this are very annoying to track down.

          Its more or less impossible to make this mistake in rust because of how mutability is enforced. The mutability rules are sometimes annoying in the small, but in the large they tend to make your code much easier to reason about.

          C has multiple problems like this. I've worked in plenty of codebases which had obscure race conditions due to how we were using threading. Safe rust makes most of these bugs impossible to write in the first place. But the other thing I - and others - run into all the time in C is code that isn't clear about ownership and lifetimes. If your API gives me a reference to some object, how long is that pointer valid for? Even if I now own the object and I'm responsible for freeing it, its common in C for the object to contain pointers to some other data. So my pointer might be invalid if I hold onto it too long. How long is too long? Its almost never properly specified in the documentation. In C, hell is other people's code.

          Rust usually avoids all of these problems. If I call a function which returns an object of type T, I can safely assume the object lasts forever. It cannot be mutated by any other code (since its mine). And I'm not going to break anything else if I mutate the object myself. These are really nice properties to have when programming at scale.

        • UltraSane 1 hour ago
          async seems sensible for anything subject to internet latency.
      • andrewmcwatters 3 hours ago
        [dead]
    • batisteo 4 hours ago
      C was designed as a high level language and stayed so for decades
  • andsoitis 6 hours ago
    > Memory Safe

    > No garbage collector, no manual memory management. A work in progress, though.

    I couldn't find an explanation in the docs or elsewhere how Rue approaches this.

    If not GC, is it via:

    a) ARC

    b) Ownership (ala Rust)

    c) some other way?

    • steveklabnik 5 hours ago
      I am playing around with this! I'm mostly interested in something in the space of linear types + mutable value semantics.
      • jasonwatkinspdx 3 hours ago
        You might find one of my late brother's research interests relevant: https://www.cs.princeton.edu/~dpw/papers/space.pdf
        • steveklabnik 3 hours ago
          Thank you for the link! I'll check it out for sure.

          (And sorry to hear about your brother's passing.)

      • echelon 5 hours ago
        Nice! I see you're one of (if not the primary) contributor!

        Do you see this as a prototype language, or as something that might evolve into something production grade? What space do you see it fitting into, if so?

        You've been such a huge presence in the Rust space. What lessons do you think Rue will take, and where will it depart?

        I see compile times as a feature - that's certainly nice to see.

        • steveklabnik 5 hours ago
          This is a project between me and Claude, so yeah :)

          It's a fun project for me right now. I want to just explore compiler writing. I'm not 100% sure where it will lead, and if anyone will care or not where it ends up. But it's primarily for me.

          I've described it as "higher than Rust, lower than Go" because I don't want this to be a GC'd language, but I want to focus on ergonomics and compile times. A lot of Rust's design is about being competitive with C and C++, I think by giving up that ultra-performance oriented space, I can make a language that's significantly simpler, but still plenty fast and nice to use.

          We'll see.

          • echelon 3 hours ago
            Love it! I think that's a nice target.

            Have fun! :)

      • oulipo2 4 hours ago
        So linear type + mutable value would be quite close to Rust, right?
        • steveklabnik 4 hours ago
          Rust has affine types, not linear. It also doesn't have mutable value semantics, it uses references, lifetimes, and borrowing.
          • EnPissant 4 hours ago
            I've never seen any significant difference in linear vs affine types.

            To me it just seems like Rust has Linear types, and the compiler just inserts some code to destroy your values for you if you don't do it yourself.

            I guess the only difference is that linear types can _force_ you to manually consume a value (not necessarily via drop)? Is that what you are going for?

            • steveklabnik 4 hours ago
              Affine types are "may use" and linear types are "must use," yeah. That is, linear types are stronger.

              See https://faultlore.com/blah/linear-rust/ for a (now pretty old but still pretty relevant, I think) exploration into what linear types would mean for Rust.

  • lifis 4 hours ago
    All the Rue code in the manual seems to also be valid Rust code, except for the @-prefixed intrinsics
    • steveklabnik 3 hours ago
      Yes, I started off with the idea that Rue's syntax would be a strict subset of Rust's.

      I may eventually diverge from this, but I like Rust's syntax overall, and I don't want to bikeshed syntax right now, I want to work on semantics + compiler internals. The core syntax of Rust is good enough right now.

      • scuff3d 1 hour ago
        Out of interest, what's the motivation? What are you hoping to do with Rue that Rust doesn't currently provide?
      • emerent 3 hours ago
        How is it a subset then if it has the @-prefix? Wait, does Rust's grammar still have the @ and ~ sigils from the pre 1.0 times for pointers?
        • steveklabnik 3 hours ago
          It started off that way, but didn't (and won't) remain that way.

          I'm using @ for intrinsics because that's how Zig does it and I like it for similar reasons to how Rust uses ! for macros.

  • jameskilton 5 hours ago
    Probably best to link to the repo itself, this is not meant to be used yet. https://github.com/rue-language/rue
  • waldrews 42 minutes ago
    What the world needs is a more expressive language than Go, that interops with Go's compilation model and libraries.
  • reactordev 2 hours ago
    I write a lot of go. I tried to write a lot of rust but fell into lifetime traps. I really want to leave C++ but I just can’t without something that’s also object oriented.

    Not a dig at functional, it’s just my big codebases are logically defined as objects and systems that don’t lend itself to just being a struct or an interface.

    Inheritance is why I’m stuck in C++ land.

    I would love to have something like rust but that supports classes, virtual methods, etc. but I guess I’ll keep waiting.

    • scuff3d 1 hour ago
      In Rust you can have structs with any number of methods defined on them, which is functionally not that different from a class. You get interface like behavior with traitsz and you get encapsulation with private/public data and methods.

      Does inheritance really matter that much?

      • reactordev 28 minutes ago
        Yes it does. Unless I can attach a trait to a struct without having to define all the methods of that trait for that struct. This is my issue with interfaces and go. I can totally separate out objects as interfaces but then I have to implement each implementation’s interface methods and it’s a serious chore when they’re always the same.

        For example: Playable could be a trait that plays a sound when you interact with it. I would need to implement func interact for each object. Piano, jukebox, doorbell, etc. With inheritance, I write it once, add it to my class, and now all instances of that object have interact. Can I add instance variables to a trait?

        This saves me time and keeps Claude out of my code. Otherwise I ask Claude to implement them all, modify them all, to try to keep them all logically the same.

        I also don’t want to go type soup in order to abstract this into something workable.

    • steveklabnik 2 hours ago
      I respect your preferences, but I am unlikely to add this sort of OOP. Ideally there'll be no subtyping at all in Rue. So you'll have to keep waiting, I'm afraid. Thanks for checking it out regardless!
    • amluto 2 hours ago
      As a long time C++ user, I’m curious why you like inheritance and virtual methods so much.

      I maintain a medium sized, old-ish C++ code base. It uses classes and inheritance and virtual methods and even some multiple inheritance. I despise this stuff. Single Inheritance is great until you discover that you have a thing that doesn’t slot nicely into the hierarchy or when you realize that you want to decompose an interface (cough, base class) into a couple of non-hierarchically related things. Multiple inheritance is an absolute mess unless you strictly use base classes with pure virtual methods and no member variables. And forcing everything into an “is a” relationship instead of a “has a” relationship can be messy sometimes.

      I often wish C++ had traits / or Haskell style type classes.

      • xpe 35 minutes ago
        Ah, yes, multiple inheritance in C++: where order matters but sanity does not
  • misir 38 minutes ago
    Any plans for adding algebraic data types (aka rust enums)?
  • chrysoprace 2 hours ago
    It may have been more useful to link to the blog post [0] which gives more of an introduction than the front page at this point.

    [0] https://rue-lang.dev/blog/hello-world/

  • coffeeaddict1 4 hours ago
    How does this differ from Hylo [0]?

    [0] https://hylo-lang.org

    • steveklabnik 4 hours ago
      I am very interested in Hylo! I think they're playing in similar spaces. I'd like to explore mutable value semantics for Rue.

      One huge difference is that Hylo is using LLVM, whereas I'm implementing my own backends. Another is that Hylo seems to know what they want to do with concurrency, whereas I really do not at all right now.

      I think Hylo takes a lot of inspiration from Swift, whereas I take more inspiration from Rust. Swift and Rust are already very similar. So maybe Hylo and Rue will end up like this: sister languages. Or maybe they'll end up differently. I'm not sure! I'm just playing around right now.

  • oulipo2 4 hours ago
    Interesting, for me the "between Rust and Go" would be a nice fit for Swift or Zig. I've always quite liked the language design of Swift, it's bad that it didn't really take off that much
    • steveklabnik 4 hours ago
      One thing working on this project has already done is give me more appreciation for a lot of Zig's design.

      Zig really aims to be great at things I don't imagine Rue being useful for, though. But there's lots of good stuff there.

      And lots of respect to Swift as well, it and Hylo are also major inspiration for me here.

    • vips7L 3 hours ago
      Checkout Borgo: https://github.com/borgo-lang/borgo

      I also find that D is good between language. You can do high level or low level whenever you need it.

      You can also do some inbetween systems programming in C# if you don’t care about a VM or msft.

      • behindsight 2 hours ago
        > You can also do some inbetween systems programming in C# if you don’t care about a VM or msft.

        C# Native AOT gets rid of the JIT and gives you a pretty good perf+memory profile compared to the past.

        It's mostly the stigma of .NET Framework legacy systems that put people off, but modern C# projects are a breeze.

        • vips7L 1 hour ago
          AFAIK there’s still holes like reflection and you have some work, but if that’s changed that’s really good. I suspect it’ll be hard for C# to escape the stench of “enterprise” though.

          I’m looking forward to seeing how it shapes out over the next few years. Especially once they release union types.

        • neonsunset 44 minutes ago
          [dead]
  • frizlab 4 hours ago
    How does this compare to Swift?
    • steveklabnik 4 hours ago
      I don't plan on implementing ARC, I don't think. I do think Swift/Hylo mutable value semantics is a neat idea that I do want to play around with.
  • norir 5 hours ago
    I wince every time I see naive recursive fibonacci as a code example. It is a major turnoff because it hints at a lack of experience with tail call optimization, which I consider a must have for a serious language.
    • stouset 5 hours ago
      Would someone please explain to me why TCO—seemingly alone amongst the gajillions of optimization passes performed by modern compilers—is so singularly important to some people?
      • zephen 1 minute ago
        It virtue-signals that they're part of the hip functional crowd.
      • Rusky 5 hours ago
        TCO is less of an optimization (which are typically best-effort on the part of the compiler) and more of an actual semantic change that expands the set of valid programs. It's like a new control flow construct that lives alongside `while` loops.
      • oersted 5 hours ago
        For people that like functional style and using recursion for everything, TCO is a must. Otherwise there’s no way around imperative loops if you want decent performance and not having to worry about the stack limit.

        Perhaps calling it an “optimization” is misleading. Certainly it makes code faster, but more importantly it’s syntax sugar to translate recursion into loops.

      • aaronblohowiak 5 hours ago
        functional programming background / SICP ?
    • steveklabnik 5 hours ago
      I only have basic constant folding yet in terms of optimizations, but I'm very aware of TCO. I haven't decided if I want to require an annotation to guarantee it like Rust is going to.
    • dullcrisp 2 hours ago
      Plus we all know that fibs = 1 : 1 : zipWith (+) fibs (tail fibs) is the only serious Fibonacci implementation.
      • xpe 33 minutes ago
        Who thunk of that one?
    • airstrike 4 hours ago
      "Well you can judge the whole world on the sparkle that you think it lacks.

      Yes, you can stare into the abyss, but it's staring right back"