Providing your Windows device is newer or the same as Microsoft's Surface Pro LTE, your phone should be compatible with an eSIM.
If you would like to check this, you can do so by following these steps:
1. Go into Settings.
2. Scroll until you see the option of "About phone"
3. On this page you should now see the device model / name.