Big Data & Tools with NoSQL
  • Big Data & Tools
  • ReadMe
  • Big Data Overview
    • Overview
    • Job Opportunities
    • What is Data?
    • How does it help?
    • Types of Data
    • The Big 4 V's
      • Variety
      • Volume
      • Velocity
      • Veracity
      • Other V's
    • Trending Technologies
    • Big Data Concerns
    • Big Data Challenges
    • Data Integration
    • Scaling
      • CAP Theorem
      • Optimistic concurrency
      • Eventual consistency
      • Concurrent vs. Parallel Programming
    • Big Data Tools
    • No SQL Databases
    • What does Big Data learning means?
  • Linux & Tools
    • Overview
    • Linux Commands - 01
    • Linux Commands - 02
    • AWK
    • CSVKIT
    • CSVSQL
    • CSVGREP
  • Data Format
    • Storage Formats
    • CSV/TSV/Parquet
    • Parquet Example
    • JSON
    • HTTP & REST API
      • Terms to Know
        • Statefulness
        • Statelessness
        • Monolithic Architecture
        • Microservices
        • Idempotency
    • REST API
    • Python
      • Setup
      • Decorator
      • Unit Testing
      • Flask Demo
      • Flask Demo - 01
      • Flask Demo - 02
      • Flask Demo - 03
      • Flask Demo - 04
      • Flask Demo - 06
    • API Testing
    • Flask Demo Testing
    • API Performance
    • API in Big Data World
  • NoSQL
    • Types of NoSQL Databases
    • Redis
      • Overview
      • Terms to know
      • Redis - (RDBMS) MySql
      • Redis Cache Demo
      • Use Cases
      • Data Structures
        • Strings
        • List
        • Set
        • Hash
        • Geospatial Index
        • Pub/Sub
        • Redis - Python
      • Redis JSON
      • Redis Search
      • Persistence
      • Databases
      • Timeseries
    • Neo4J
      • Introduction
      • Neo4J Terms
      • Software
      • Neo4J Components
      • Hello World
      • Examples
        • MySQL: Neo4J
        • Sample Transactions
        • Sample
        • Create Nodes
        • Update Nodes
        • Relation
        • Putting it all together
        • Commonly used Functions
        • Data Profiling
        • Queries
        • Python Scripts
      • More reading
    • MongoDB
      • Sample JSON
      • Introduction
      • Software
      • MongoDB Best Practices
      • MongoDB Commands
      • Insert Document
      • Querying MongoDB
      • Update & Remove
      • Import
      • Logical Operators
      • Data Types
      • Operators
      • Aggregation Pipeline
      • Further Reading
      • Fun Task
        • Sample
    • InfluxDB
      • Data Format
      • Scripts
  • Python
    • Python Classes
    • Serialization-Deserialization
  • Tools
    • JQ
    • DUCK DB
    • CICD Intro
    • CICD Tools
      • CI YAML
      • CD Yaml
    • Containers
      • VMs or Containers
      • What container does
      • Podman
      • Podman Examples
  • Cloud Everywhere
    • Overview
    • Types of Cloud Services
    • Challenges of Cloud Computing
    • High Availability
    • Azure Cloud
      • Services
      • Storages
      • Demo
    • Terraform
  • Data Engineering
    • Batch vs Streaming
    • Kafka
      • Introduction
      • Kafka Use Cases
      • Kafka Software
      • Python Scripts
      • Different types of Streaming
    • Quality & Governance
    • Medallion Architecture
    • Data Engineering Model
    • Data Mesh
  • Industry Trends
    • Roadmap - Data Engineer
    • Good Reads
      • IP & SUBNET
Powered by GitBook
On this page
  • Azure Blob Storage:
  • Azure Data Lake Storage:
  • Azure Table Storage:
  • Azure Disk Storage:
  • Azure File Storage:
  • Azure Queue Storage:
  1. Cloud Everywhere
  2. Azure Cloud

Storages

Azure Blob Storage:

  • Blob storage is designed for storing large amounts of unstructured data, such as images, videos, backups, log files, and other binary data.

  • It provides three different access tiers: Hot (frequently accessed data), Cool (infrequently accessed data), and Archive (rarely accessed data).

  • Blob storage offers high scalability, availability, and durability.

Example: A media streaming service can store video files, audio files, and images in Blob storage. The files can be accessed from anywhere and served to users on various devices.

Azure Data Lake Storage:

  • Data Lake Storage is a secure, scalable, and massively parallel data storage service optimized for big data analytics workloads.

  • It supports storing and processing structured, semi-structured, and unstructured data in a single location.

  • Azure Data Lake Storage integrates with Azure HDInsight, Azure Databricks, and other big data analytics services.

Example: Best suited for storing Data files such as csv, parquet. As it offers hierarchical namespace to store folders and files. Economical and offers path based syntax (abfss://conatiner@storage/folder/file.csv)

Azure Table Storage:

  • Table storage is a NoSQL key-value store designed for storing semi-structured data.

  • It provides a schemaless design, allowing you to store heterogeneous data types.

  • Table storage is suitable for storing structured, non-relational data with massive scale and low-cost storage.

Example: A mobile application can store user profiles, preferences, and other structured data in Azure Table Storage. The schemaless design of Table Storage allows for flexible data modeling and easy scalability as the application grows.

Azure Disk Storage:

  • Disk storage provides persistent storage for Azure Virtual Machines (VMs).

  • It offers different disk types, such as Ultra Disks, Premium SSDs, Standard SSDs, and Standard HDDs, to meet various performance and cost requirements.

  • Disk storage is used for operating system disks, data disks, and temporary disks for Azure VMs.

Example: An e-commerce website can use Azure Disk Storage to store the operating system disks and data disks for the virtual machines running the web application and database servers.

Azure File Storage:

  • File storage provides fully managed file shares that can be mounted and accessed like a regular file system.

  • It allows you to share files between virtual machines (VMs), applications, and on-premises deployments.

  • Azure File Storage supports the Server Message Block (SMB) protocol and Network File System (NFS) protocol.

Example: A development team can create a file share using Azure File Storage to store and share source code, documentation, and other project files. The file share can be accessed concurrently by multiple team members, regardless of their location.

Azure Queue Storage:

  • Queue storage is a messaging service that enables you to store and retrieve messages in a queue.

  • It is commonly used for building reliable and scalable cloud-based applications and services.

  • Messages can be processed asynchronously, enabling decoupled communication between components.

Example: A web application can use Azure Queue Storage to offload resource-intensive tasks, such as image processing or sending email notifications, to a queue.

PreviousServicesNextDemo

Last updated 1 year ago