Skip to content

Container Services - Introduction

Goal of this tutorial is to move our Streamlit in Snowflake "SiS" application into Snowflake container services. This is a typical workflow to remove the Snowflake headers around the application.

Video

Requirements

  • Be in a container services enabled region.(Link)
  • You can NOT be on a trial account. (Link)

Download

Setup

Lets go through some setup before to go into our application.

Snowflake

Let's start by setting up Snowflake before we jump to docker. Create a worksheet in snowflake and add / run the code below.

If you don't have a database, schema or warehouse yet. 
use role sysadmin;

-- Create a database to store our schemas.
create database raw;

-- Create the schema. The schema stores all our objectss.
create schema raw.website;

/*
    Warehouses are synonymous with the idea of compute
    resources in other systems. We will use this
    warehouse to call our user defined function.
*/
create warehouse if not exists developer 
    warehouse_size = xsmall
    initially_suspended = true;

use database raw;
use schema website;
use warehouse developer;

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
use role sysadmin;

-- Compute pool to run containers on.
create compute pool cpu_x64_xs
    min_nodes = 1
    max_nodes = 1
    instance_family = cpu_x64_xs;

-- Image registry to upload our docker image to.
create or replace image repository raw.website.docker;

-- Give us the url to upload our docker container to.
show image repositories;
select "repository_url" from table(result_scan(last_query_id()));
repository_url
sfsenorthamerica-wilczak-videos2.registry.snowflakecomputing.com/raw/website/images

Docker

Our goal is to run the application locally and check if it works and then upload the built docker image to our snowflake image repository so it can be hosted on Snowflake container services.

Note

Please install docker desktop - https://www.docker.com/products/docker-desktop/

Using terminal, navigate to the folder that has the docker file you downloaded. Terminal

1
2
docker build --platform linux/amd64 -t website .
docker run --rm -p 8501:8501 website

1
2
3
4
You can now view your Streamlit app in your browser.

Local URL: http://localhost:8501
Network URL: http://172.17.0.2:8501

Now you can go to Localhost or the direct local url http://127.0.0.1:8501/. To see what the website will look like before we upload it.

Upload

Now that we have our image created. Lets upload it to Snowflake. We will need our Snowflake image url (1) that we got from our Snowflake setup.

  1. repository_url
    sfsenorthamerica-wilczak-videos2.registry.snowflakecomputing.com/raw/docker/images 
1
docker tag website <URL GOES HERE>/flask:website

1
2
docker tag website \
sfsenorthamerica-wilczak-videos2.registry.snowflakecomputing.com/raw/website/docker/website

Next docker login to our snowflake image repo and upload the image. We will use the login name that has access to sysadmin role.

1
docker login <FIRST PART OF THE URL> -u <LOGIN USERNAME>

1
docker login sfsenorthamerica-wilczak-videos2.registry.snowflakecomputing.com/ -u danielwilczak
If your user is using MFA - Please enable token caching before uploading

Docker will upload the image in a multi threaded way, if you have MFA it will ask you a hundred times. To prevent this we suggest to enable token caching.

alter account set allow_client_mfa_caching = TRUE;

Finally push the image to your image repository living on Snowflake.

1
docker push <URL GOES HERE>/website

1
docker push sfsenorthamerica-wilczak-videos2.registry.snowflakecomputing.com/raw/website/docker/website

The push refers to repository [sfsenorthamerica-wilczak-videos2.registry.snowflakecomputing.com/raw/website/docker/website]
5c496785191b: Pushed 
af426fba40ce: Pushed 
89732b928ca7: Pushed 
c3fcfdebbdeb: Pushed 
5930c727f5d3: Pushed 
fe4e91e03123: Pushed 
1ee7a83db2c7: Pushed 
57bbd9d1460f: Pushed 
2920aec4783e: Pushed 
61255a2b6a94: Pushed 
4c519b360763: Pushed 
abf3d7b50651: Pushed 
a0b7220ad76b: Pushed 
website: digest: sha256:f0ef0b8e2a6e9fa218fd7cd771bce6befeecd1d62a26c740df8fb8b45ed6831c size: 3045

Run

Lets switch back to snowflake to start our container.

Start Service

Create the service to host the container with our inline service specification..

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
use role sysadmin;
use database raw;
use schema website;

create service streamlit_application
    in compute pool cpu_x64_xs
    from specification $$
    spec:
    containers:
        - name: website
        image: /raw/website/docker/website

    endpoints:
        - name: main
        port: 8501
        public: true
    $$;

-- Give us a URL to see our application.
show endpoints in service streamlit_application;
select "ingress_url" from table(result_scan(last_query_id()));
ingress_url
br2sbye-sfsenorthamerica-wilczak-videos2.snowflakecomputing.app

Set default role

Before we go to our URL. Please make sure your default role is set to Sysadmin Role default

Now go to the webiste url, login and see your amazing website! Terminal

Clean up script

If you don't plan to keep this running. Which I don't reccomend considering it's using .11 credits per hour. Here is a clean up script.

1
2
3
4
5
6
use role sysadmin;

drop service streamlit_application;
drop compute pool cpu_x64_xs;
drop warehouse developer;
drop database raw;
status
RAW successfully dropped.