Tag: wsl2

Spark Installation in WSL2

Step 1. Install required files Install java and spark file. (Skip if already installed.) 123$ sudo apt-get install openjdk-8-jdk$ sudo wget https://archive.apache.org/dist/spark/spark-3.2.0/spark-3.

ElasticSearch and Kibana Setting in WSL 2

Step 1. Install Package Update the system package and install a package related to HTTPS. 12$ sudo apt update$ sudo apt install apt-transport-https Install Java and check the version of Java. 1234

Link VSCode with Remote WSL

Step 1. Install VSCode URL : https://code.visualstudio.com/download Download the System Installer for each OS. Check ‘Add to PATH’ and reboot after installation. Step 2. Link Remote WSL Ins

Establishing an Airflow Data Pipeline

Step 01. Create a Virtual Data Create dags foler below (venv) airflow-test folder. 1234$ mkdir dags$ lsairflow-webserver.pid airflow.cfg airflow.db dags logs venv webserver_config.py Install

Apache-Airflow Setting in Windows11 (WSL 2)

Step 1. Create a virtual environment Install pip and virtualenv package 12$ sudo apt install python3-pip$ sudo pip3 install virtualenv Create a virtual environment in c:\airflow-test folder 123456

WSL 2 Installation in Windows11

Step 1. Enable WSL-related features by DISM Run Windows Terminal as administrator Enable Microsoft-Windows-Subsystem-Linux Features 1$ dism.exe /online /enable-feature /featurename:Microsoft-Win