Abstract
If you’re a data analyst or data scientist or you’re on an executive team, you know the value of access to continuous and timely data at any given time. You want to know that whenever you’re querying data, transforming it, or accessing it in any way that the data represents the most up-to-date information available to use for data analysis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
For more information, see https://en.wikipedia.org/wiki/Representational_state_transfer.
- 4.
For more information, see https://kafka.apache.org/.
- 5.
For more information, see https://docs.snowflake.net/manuals/user-guide/kafka-connector.html.
- 6.
E-mail: support@snowflake.com
- 7.
AWS Kinesis is group of services related to real-time and near-real-time data ingestion. For more information, see https://aws.amazon.com/kinesis/.
- 8.
For more about the AWS Managed Streaming service for Kafka, see https://docs.aws.amazon.com/msk/latest/developerguide/what-is-msk.html.
- 9.
Apache Kafka is an open source stream-processing software platform. For more information. see https://kafka.apache.org/documentation/.
- 10.
AWS SQS is an Amazon Queue service. For more information, see https://docs.aws.amazon.com/sqs/index.html.
- 11.
JSON file format: https://json.org/
- 12.
Apache AVRO file format: https://avro.apache.org/
- 13.
ORC file format: https://orc.apache.org/
- 14.
Parquet file format: https://parquet.apache.org/
- 15.
XML file format: https://en.wikipedia.org/wiki/XML
- 16.
For more information, see https://docs.snowflake.net/manuals/sql-reference/data-types-semistructured.html.
- 17.
For more information, see https://docs.snowflake.net/manuals/sql-reference/sql/create-stage.html.
- 18.
For more information, check https://docs.aws.amazon.com/general/latest/gr/aws-security-credentials.html.
- 19.
- 20.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2020 Dmitry Anoshin, Dmitry Shirokov, Donna Strok
About this chapter
Cite this chapter
Anoshin, D., Shirokov, D., Strok, D. (2020). Continuous Data Loading with Snowpipe. In: Jumpstart Snowflake. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-5328-1_6
Download citation
DOI: https://doi.org/10.1007/978-1-4842-5328-1_6
Published:
Publisher Name: Apress, Berkeley, CA
Print ISBN: 978-1-4842-5327-4
Online ISBN: 978-1-4842-5328-1
eBook Packages: Professional and Applied ComputingProfessional and Applied Computing (R0)Apress Access Books