Commit Graph
144 Commits
Author SHA1 Message Date
adrien 154a146678 Missing from previous commit 2025-01-16 20:45:50 +01:00
adrien a9c39d9aa5 Renamed paarser.core to ziql.parser 2025-01-16 20:45:30 +01:00
adrien 6338cb6364 NewData ordered by default 2025-01-15 19:59:13 +01:00
adrien e848be94c1 Good docs update, stillo need some work. Need to take a step back and think 2025-01-14 22:48:50 +01:00
adrien 9ae9b65f1e Rename ziql to parser 2025-01-14 22:42:11 +01:00
adrien 173b302976 Add number of file to db metrics 2025-01-14 22:31:55 +01:00
adrien e818700905 Use try 2025-01-13 20:06:16 +01:00
adrien c6725f6b54 Fix stdout error 2025-01-12 20:28:35 +01:00
adrien c070723baa ziql moved into a dir and splited 2025-01-12 15:33:15 +01:00
adrien 1f5da7a74b Created cli struct and dir 2025-01-12 12:37:07 +01:00
adrien 1c8384dec6 Moved stuff into a schema dir and created empty dir 2025-01-12 11:50:22 +01:00
adrien 67546d69a9 Splited fileEngine into multiple files 2025-01-12 01:25:09 +01:00
adrien 955aff0d09 Moved global error to lib and fuse to a unique one 2025-01-12 00:37:57 +01:00
adrien c0e8b07025 Moved thread stuff into a directory 2025-01-12 00:11:03 +01:00
adrien d775ff1d0a Deleted stuffs dir for a dataStructure one 2025-01-11 23:41:03 +01:00
adrien 13caff2fd7 Dump csv
Can now use command dump csv

Will see later to add json and zid format as well as loading it
2025-01-11 19:25:03 +01:00
adrien ee9d5c92f2 Some data struct now use file instead of = struct { 2025-01-11 19:24:15 +01:00
adrien 78213df3ff And other 2025-01-11 18:03:36 +01:00
adrien 90edb94f7a Same for schemaEngine 2025-01-11 17:58:52 +01:00
adrien d5f7309869 Same for ziqlParser 2025-01-11 17:57:19 +01:00
adrien 0f6f34e706 Moved fileEngine to use the root as struct 2025-01-11 17:55:56 +01:00
adrien bd4f0aab7f Removed some TODO, fix and typo 2025-01-11 16:52:19 +01:00
adrien 54146b9495 Add and remove UUID from index map
Now remove and add UUID in the sstruct map UUID -> File index
2025-01-11 16:08:46 +01:00
adrien 1495e779c9 Speed up date
Date was taking a long time for parsing when using ADD in batch, speeded
up by like x50
2025-01-11 15:27:17 +01:00
adrien 7d012b527f Write every 1000 map
Now if I run a big ADD query, write every 1000 entities to prevent a
maps array too big and go OOM
2025-01-11 13:50:32 +01:00
adrien d533eaff98 Working multi struct schema with relationship!
Noce
2025-01-08 23:53:41 +01:00
adrien 71e5f6eb1e Started to debug schema with multiple struct and some time keyword
Added NOW already and now debuging some stuff regarding filter and
parsing file of one struct when it should be another

Also moved query test into a seperated test file.
And some fix and changed in docs
2025-01-08 10:09:15 +01:00
adrien a712fe3e83 Save schema file when using new 2025-01-07 17:15:09 +01:00
adrien 65fa7ccfc4 Now delete empty file when deleting entities exept 0.zid 2025-01-07 14:09:22 +01:00
adrien 2a4842432d Speed up batch ADD and better bechmark
Now I flush only when the file is full and I check the the currently
used file if it is big enough.

So I dont get stat of all files and flush everytime like before
2025-01-07 13:55:02 +01:00
adrien e3264d8553 Random ADD for benchmark 2025-01-06 20:45:16 +00:00
adrien 900b9e5305 Moved benchmark outside of src and making it better 2025-01-02 13:28:23 +00:00
adrien b075f8b89a Moved config to libs 2025-01-02 12:19:05 +00:00
adrien 4f421f7977 Added ADD in batch 2024-12-30 15:31:16 +01:00
adrien a535ce5283 Basic benchmark command 2024-12-30 14:09:59 +01:00
adrien a7d076ec80 Added !IN 2024-12-30 12:08:25 +01:00
adrien 2e2dae3df1 Some typo 2024-12-29 10:19:04 +01:00
adrien b2dd6fe627 Basic working relationship
It is working !

The basic GRAB [name, best_friend] work and do return the best friend
infos.

I added more test and some do not work yet, working on it now
2024-12-28 20:12:20 +01:00
adrien 3b47007ca4 Base reparsing
This dosnt work yet but I implemented the reparsing of the files to
return relationship.

So GRAB User [name, friends] should return all infos of all friends and
not just the UUID of those friends like before
2024-12-27 12:42:51 +01:00
adrien 0127daa330 Push before leaving for christmas 2024-12-21 15:13:50 +01:00
adrien e7056efec9 Now query with relationship will write the UUID bytes betwen {|<>|}
So then I can parse the file again, create a map of UUID sub json and
just iterate over the first json looking for UUID and update with new
data from map
2024-12-20 22:29:02 +01:00
adrien 7fb0b5f63e Changed memory in AdditionalData
Now it need to use an arena because there is no deinit function.

And additionalData of member are null by default instead of an empty
list.
2024-11-30 10:33:28 +01:00
adrien 57a9eecdb3 Renamed members of AdditionalData 2024-11-30 09:49:54 +01:00
adrien c6fe428270 Dont send link if not in AdditionalData 2024-11-29 21:56:52 +01:00
adrien 4ee79c9629 Created an EntityWriter responsable for writing into JSON and table into a writer 2024-11-29 21:38:05 +01:00
adrien 7f27557ca2 Fix parsing array
Before if the array is [ 1 ] I get [ 0, 1, 0] because I get 2 empty
string that when I try to make into int, it become 0
2024-11-29 21:20:12 +01:00
adrien 3f53da5220 Making link_array working, now can do query with filter for array of ofther struct 2024-11-28 19:20:44 +01:00
adrien 12ae7f9a62 Added db state command and fixed printError
I was using the same buffer at 2 place :/
2024-11-26 22:59:36 +01:00
adrien 08cae48cbc Added a writeEntityTable and fixed date and time 2024-11-24 22:26:54 +01:00
adrien 1333b75981 Dont trow and error on basic relationship query 2024-11-24 20:10:21 +01:00