Keep VB6 installed on a single old laptop or a Windows Server VM in your office. Use a portable RDP client (like mstsc.exe built into Windows) to remote in. Your "portable client" is just the RDP file.
For new projects, Microsoft recommends the latest Visual Studio , which is free for individuals and supports modern VB.NET. visual basic 6.0 portable download
Once installed this way, the IDE is technically not portable but will run on modern Windows for years without the risks of a hacked portable version. Keep VB6 installed on a single old laptop