Fast & Secure Remote Access: SSH from Windows 10 to Linux

Set up a secure, passwordless SSH connection from Windows 10 to a Linux server for fast, repeatable, and automation‑friendly access.

Linux Windows

Scenario

Your team manages several Linux servers hosted in the cloud and on‑premises. Most administrators use Windows 10 workstations, and they frequently need to log into Linux machines to run updates, deploy code, or troubleshoot issues.

However, the current workflow is slow and inconsistent:

  • Admins manually type passwords every time
  • Some use PuTTY, others use PowerShell
  • Automation scripts fail because they require interactive logins
  • Security policies discourage password‑based authentication

To streamline operations and improve security, the team wants a fast, secure, and standardised method for connecting from Windows 10 to Linux, ideally without entering a password each time.

Lab Objectives

  • Use the built‑in Windows 10 SSH client
  • Generate SSH keys on Windows
  • Copy your public key to a Linux server
  • Log in without a password
  • Securely manage remote Linux systems from Windows

Prerequisites

  • Windows 10 workstation
  • Linux server with SSH enabled
  • Network connectivity between Windows and Linux
  • Basic command‑line familiarity

Lab Setup

Based on the original environment described in your post:

  • Workstation: Windows 10
  • Remote server: Linux VM
    • Example IP: 10.0.10.101
    • Network: 10.0.10.0/24
  • Tools:
    • Windows built‑in SSH client
    • PowerShell
    • Linux terminal

Why SSH?

SSH (Secure Shell) is the industry standard for remote server access because it:

  • Encrypts all communication
  • Supports strong key‑based authentication
  • Eliminates password reuse risks
  • Enables automation and scripting
  • Works across all major operating systems

Passwordless SSH is not only more convenient, it’s more secure and ideal for DevOps workflows.

Generate SSH Keys on Windows 10

Open PowerShell and run:

ssh-keygen

When prompted:

  • Press Enter to accept the default key location
  • Optionally set a passphrase (recommended for security)

This creates:

  • Private key: id_rsa
  • Public key: id_rsa.pub

Stored in:

C:\Users\<your-username>\.ssh\

Copy Your Public Key to the Linux Server

Use the built‑in scp command:

scp C:\Users\<your-username>\.ssh\id_rsa.pub user@10.0.10.101:/home/user/

Then, on the Linux server:

mkdir -p ~/.ssh
cat id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/authorized_keys
chmod 700 ~/.ssh

This authorises your Windows key for SSH login.

Test Passwordless SSH Login

From Windows:

ssh user@10.0.10.101

If everything is configured correctly:

  • You should connect without entering a password
  • SSH will authenticate using your private key

This gives you fast, secure access every time.

Conclusion

You’ve now configured a secure, passwordless SSH workflow from Windows 10 to a Linux server. This setup:

  • Speeds up daily administration
  • Improves security by eliminating passwords
  • Enables automation and scripting
  • Standardizes access across your team

SSH key‑based authentication is a foundational skill for DevOps, cloud engineering, and Linux administration and now you’ve got it running cleanly on Windows 10.

Lab Video

Watch On YouTube
Get NordVPN