Question

[jtgooding2]

First thank you for all the work you have put into this project and making it available, it is commendable.  My question is there any option at all other than kafka as the target, i.e. even file based landed in folder(s), my target will be Delta Lake (Databricks/Fabric) or Iceberg (Snowflake) I can handle all the Delta/Iceberg integrations I would just prefer to not go through Kafka if at all possible.  
I will be honest I haven't dug super deep into the documentation, but at first glance I didn't see basic things like baseline/full load, csn/lsn tracking exposer to say, read current, do my full, then parse through logs/kafka messages to apply changes from the base marker etc.   
Thanks and if this is all covered in the docs if you could point to what I missed or if it is intended to work in a different manner then let me know. Thanks again and great work.

[averemee-si]

Hi John,

Thanks for your feedback and kind words - greatly appreciated!

You're correct - currently, the main platform for this project is Apache Kafka. However, we're actively exploring additional options and directions. Specifically:

• ora2iceberg: inspired by ora2pg, the tool for migrating baseline from Oracle to Apache Iceberg tables. You might find it useful for your case, especially if your data is immutable or for initial or periodical load of Oracle . Please check it out to see if it aligns with your requirements.

• Iceberg integration in oracdc: additionally, we're actively working on adding direct Iceberg support into oracdc, which could potentially simplify your workflow.

Regarding your specific question - yes, it is indeed possible to bypass Kafka and use file-based outputs directly (e.g., landing files in folders before loading into Delta Lake or Iceberg). Our solution is based on Chronicle Queue's memory mapped files so it is easy to go without Apache Kafka and build real RT delivery to external systems. However, this currently would involve a slightly different approach or even a different tool.

It might be beneficial to jump on a call to discuss your scenario in detail and see how we can best support your needs (We're in EST and CET TZs). Let me know if that works for you!

Thanks again for reaching out, and looking forward to discussing this further.

Best regards,
Aleksei

[jtgooding2]

I am Eastern, is there a way to send a private message on here to give you contact info?

[averemee-si]

Hi John,

You can send me an email to averemee@a2.solutions

Best regards,
Aleksei