ZipponDB/docs/TODO v0.2.md

• Delete the .new file if an error happend
• Create a struct that manage the schema

Relationships

• Update the schema Parser and Tokenizer
• Include the name of the link struct with the schema_struct
• New ConditionValue that is an array of UUID
• When relationship found in filter, check if the type is right and exist
• When parseFilter, get list of UUID as value for relationship
• Add new operation in Filter evalue: IN and !IN
• parseNewData can use filter like in "Add User (friends = [10] {age > 20})" to return UUID
• parseFilter can use sub filter. "GRAB User {friends IN {age > 20}}" At least one friend in a list of UUID
• When send, send the entities in link specify between []

Optimizations

• Parse file one time for all conditions, not once per condition
• parse file in parallel, multi threading
  • GRAB
  • DELETE
  • UPDATE
• Radix Tries ofr UUID list

ADD User (name='Bob', age = 44, best_friend = {id=0000-0000}) => new_user => UPDATE User {id = 0000-0000} TO (best_friend = new_user)

GRAB User [friends] {best_friends IN {name = 'Bob'}}

Question. How de fuck I am parsing files to get relationships ?

I dont want to parse them more than 3, best 2, perfect 1

The issue is that, I could do optimization here but I dont have enough yet. I need to start doing something that work then I will see. So I parse:

• All files that

Now this is where the Radix tree come into place. Because if I get to find one UUID in 50000 files, and I parse all of them, this is meh. So I need a Radix tree to be able to find all file to parse.

1. Get the list of UUID that need to be parse. For example if I do "GRAB User [mom] {name = 'Bob'}". I parse one time the file to get all UUID of User that represent mom; the parse that is already done and need to be done. So if I found 3 Bob's mom UUID
2. Then I create a map of Bob's UUID as keys and a Str as value. The Str is the JSON string of the mom. For that I need to parse the file again and write using additional_data

Radix tree

Ok so new problem. Given a list of UUID, I need a way to find all file index to parse. And even better if I can get the number of UUID per files, so I can stop parsing them early.

Happy to annonce the v0.2 of my database. New feature include:

• Relationship
• Huge performance increase with multi threading
• Date, time and datetime type
• Compressed binary files
• Logs

All core features of the query language, exept linked queries, is working, v0.3 will focus on adding things around it, including:

• Schema migration
• Dump/Bump data
• Recovery
• Better CLI

Query optimization for later:

• If a filter use id to find something, to stop after find it, as I know there is no other struct with the same id