Paging Through a Parquet File in DuckDB: File_row_number or Offset?

2 comments

• RobinL 1 hour ago
  There's also a pseudocolumn called rowid that's worth knowing about for similar purposes but on duckdb tables:

  https://duckdb.org/docs/lts/sql/statements/select#:~:text=Ro...
• matharmin 2 hours ago
  I'd assume it's common knowledge that you cannot paginate using OFFSET + LIMIT unless you use ORDER BY on an unique set of columns, no matter what database you're using. The only exception is when the database provides an explicit order guarantee without the ORDER BY, such as the case with `preserve_insertion_order = true` here.
  [-]
  • sroussey 1 hour ago
    Even then, that does not work if new records are being inserted.