# Transformer Inference with CKKS

**URL:** <https://openfhe.discourse.group/t/transformer-inference-with-ckks/1376>\
**Category:** Show & Tell\
**Created:** [June 22, 2024, 5:48pm UTC](https://openfhe.discourse.group/t/transformer-inference-with-ckks/1376 "2024-06-22T17:48:08Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![narger](https://yyz1.discourse-cdn.com/flex031/user_avatar/openfhe.discourse.group/narger/32/420_2.png) [@narger](https://openfhe.discourse.group/u/narger)\
**Post date:** [June 22, 2024, 5:48pm UTC](https://openfhe.discourse.group/t/transformer-inference-with-ckks/1376/1 "2024-06-22T17:48:08Z")

</div>

Hello there,

in case anyone is interested, I share a [repository](https://github.com/narger-ef/FHE-BERT-Tiny) in which an implementation of a classifier based on BERT-tiny is implemented using CKKS in OpenFHE.

In the related [paper](https://dl.acm.org/doi/10.1145/3643651.3659893) the circuit is analyzed step-by-step with a sort of tutorial approach. 🙂