# Experimental code columns to compress large data

**URL:** <https://community.glideapps.com/t/experimental-code-columns-to-compress-large-data/58014>\
**Category:** Ask for Help\
**Created:** [February 16, 2023, 6:01am UTC](https://community.glideapps.com/t/experimental-code-columns-to-compress-large-data/58014 "2023-02-16T06:01:45Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![miura](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/miura/32/49934_2.png) [@miura](https://community.glideapps.com/u/miura)\
**Post date:** [February 16, 2023, 6:01am UTC](https://community.glideapps.com/t/experimental-code-columns-to-compress-large-data/58014/1 "2023-02-16T06:01:45Z")

</div>

I needed to export a computed column value that was too large to send externally via webhook (a JSON string of about 10,000 rows, about 1.5 MB), so I created a string compression column.

- [Deflate by pako](https://eotel.github.io/glide-experimental-code-deflate/)
- [Inflate by pako](https://eotel.github.io/glide-experimental-code-inflate/)

Using [the pako library created by nodeca](https://github.com/nodeca/pako), I was able to compress it down to 44KB, which made exporting the data easier.

My plan does not allow me to use the API for downloading data, so I use it instead. This may be useful for people in a similar situation.

Please share your experimental code columns with us!  
Thank you.

---

<div class="post-metadata">

**Author:** ![ThinhDinh](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/thinhdinh/32/49_2.png) [@ThinhDinh](https://community.glideapps.com/u/ThinhDinh)\
**Post date:** [February 16, 2023, 11:38pm UTC](https://community.glideapps.com/t/experimental-code-columns-to-compress-large-data/58014/2 "2023-02-16T23:38:52Z")

</div>

This is interesting. What does your full flow look like? I assume you deflate it and send the ressult through the webhook, but where does the “inflate” part come into place?

---

<div class="post-metadata">

**Author:** ![Uzo](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/uzo/32/22639_2.png) [@Uzo](https://community.glideapps.com/u/Uzo)\
**Post date:** [February 17, 2023, 1:43am UTC](https://community.glideapps.com/t/experimental-code-columns-to-compress-large-data/58014/3 "2023-02-17T01:43:43Z")

</div>

You can join columns and send out with fetch Json… much easier

---

<div class="post-metadata">

**Author:** ![miura](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/miura/32/49934_2.png) [@miura](https://community.glideapps.com/u/miura)\
**Post date:** [February 17, 2023, 9:50am UTC](https://community.glideapps.com/t/experimental-code-columns-to-compress-large-data/58014/4 "2023-02-17T09:50:52Z")

</div>

The webhook triggers an aws lambda function, which performs base64 to binary conversion and inflation within the function, and then aggregates and edits the data in pandas.

My goal is to send large data to the outside at any given time. The application only compresses the data.

---

<div class="post-metadata">

**Author:** ![miura](https://sea2.discourse-cdn.com/flex002/user_avatar/community.glideapps.com/miura/32/49934_2.png) [@miura](https://community.glideapps.com/u/miura)\
**Post date:** [February 17, 2023, 10:11am UTC](https://community.glideapps.com/t/experimental-code-columns-to-compress-large-data/58014/5 "2023-02-17T10:11:35Z")

</div>

I had not tried Fetch Json. Thanks, I’ll try it next time.

At first I sent 1.5MB data via webhook. But the app and browser froze. When I looked at the developer tools, it seemed that the data was failing to be sent. I wanted to compress the data somehow.

Experimental Code Column refers to externally deployed code, but the code is executed locally. I chose this column because there is probably no data transmission overhead. I am a Glide beginner, so my understanding may be wrong.

[Translated with DeepL](https://www.deepl.com/translator?utm_source=macos&utm_medium=app&utm_campaign=macos-share)