How do we cite PhotonLibOS?

[ErvinXie]

Hello, I really appreciated your work and I am using PhotonLibOS in my new work, I want to cite your work in my paper. I see your paper on github, do you have anything like bib entry for me to cite?

[beef9999]

Maybe publish the article in arXiv.org? @lihuiba @Coldwings

[lihuiba]

Maybe publish the article in arXiv.org? @lihuiba @Coldwings

The article is not about Photon itself; it's about context switching.

[lihuiba]

Hello, I really appreciated your work and I am using PhotonLibOS in my new work, I want to cite your work in my paper. I see your paper on github, do you have anything like bib entry for me to cite?

Just cite it as an open source software project.

BTW, what's your paper about? And how you use Photon in your work?

[ErvinXie]

Thank you, I will cite PhotonLibOS like that. I am working on an LLM service system. I just use Photon to asynchronously load cache data from disk to memory.

[lihuiba]

Glad to see that Photon is used for LLM. By "cache data", do you mean kvcache?

And I want to mention that, we have also implemented with Photon a high-performance data connector that can be used for loading data files for training, or loading/saving checkpoint, or loading model files. See https://www.alibabacloud.com/help/en/oss/developer-reference/oss-connector-overview/?spm=a2c63.p38356.help-menu-31815.d_3_3_8.62c4d579yxtBLQ

[ErvinXie]

Yes, we utilized Photon to load kvcache from disk in an asynchronous way. Thanks for your recommendation of data connector. Our work is about LLM inference system. I don't whether this data connector can be also used by an inference system?

[lihuiba]

whether this data connector can be also used by an inference system?

Yes, the feature for inference systems to load model files will be released soon.