sync index to file system changes

[grahamcrowell]

Sync index to file system

1 way sync: make destination same as source

1. Get source and destination state
2. Diff state to get tasks
3. Execute tasks
4. Delete
5. Add
6. Commit

reusable sync frame work

Create a abstract framework that can be reused for other 1 way sync use cases such as search for home media server

• movie

implementation

Use akka actor to distribute sync tasks to sub actors (task type handlers) based on type of task.
Each task type has an associated akka stream. Task type handler actors append sync tasks to the source of its associated stream.
See Akka Stream queued source

task types

• read: 1 element input, 0 to many elements output
• write: 0 to many elements input, 0 elements output
• delete 0 to many elements input, 0 elements output
• 1 way sync 2 elements input, 0 elements output

also see

• index join blog post

Related issues

• Index writing service #19
• File System Walker #13
• Transform Directory Walker into Document Builder #14
• Trigger index action test #11
• Update index test #7