Skip to content

Instantly share code, notes, and snippets.

View calilisantos's full-sized avatar
🎯
Focusing

Calili Santos calilisantos

🎯
Focusing
View GitHub Profile
@calilisantos
calilisantos / client_for_url.ps1
Last active April 27, 2025 14:18
Use cases of curl in shell and DevOps
<#
CLIENT FOR URL (curl) POWERSHELL SCRIPT USE CASES
1. RUNNING THE SCRIPT:
.\client_for_url.ps1
2. RUNNING THE SCRIPT WITH DEBUGGING:
Set-PSDebug -Trace 1
Some curl flags and examples: https://reqbin.com/req/c-skhwmiil/curl-flags-example
#>
###################
@calilisantos
calilisantos / azure_blobs_info.ipynb
Last active December 27, 2024 21:49
Snippet for get size info of an azure blob storage
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@calilisantos
calilisantos / null_in_spark.ipynb
Created December 21, 2024 17:16
Quick guide to nulls in spark
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@calilisantos
calilisantos / is_type.py
Created November 28, 2024 23:38
Function to check type in Spark
from pyspark.sql import functions as F, SparkSession, types as T
spark = (
SparkSession.builder.getOrCreate()
)
data = [
("2024-01-01",),
("2024-01-01",),
("2024-01-01",),
@calilisantos
calilisantos / date_in_pyspark.ipynb
Last active November 3, 2024 14:15
Date in Spark Guide
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@calilisantos
calilisantos / pyspark_udf.ipynb
Created October 13, 2024 16:40
UDF pyspark Reload
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@calilisantos
calilisantos / value_counts_in_spark.ipynb
Created October 4, 2024 23:48
Pandas value_counts in pyspark?!
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@calilisantos
calilisantos / toggle_columns_in_spark.ipynb
Created September 21, 2024 15:21
Toggle columns in pyspark.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@calilisantos
calilisantos / notebooks_routines.ipynb
Created September 20, 2024 20:21
Notebooks routines tips
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@calilisantos
calilisantos / spark_style_guide.ipynb
Last active September 15, 2024 03:41
Spark Style Guide
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.