This isn’t quite a something I learned today, but was reminded of the importance of the commit keyword.

I kept losing work unable to figure out why. In our Data lake I was 100% sure I had made a few tables, yet a few days later when I went to use them again they were gone. This was frustrating as I had spent a bit of time on it so that was work I had to re-do.

Turns out I had forgotten the commit keyword, and as such all the table data was being lost after my session timed out. So, don’t forget to commit!