From your description it's hard to tell what's happening from your description, and there doesn't appear to be any relevant information in the Microsoft Knowledge Base, so while we can't say what the problem is we can rule out some things. Because the VPN is still connected, it's unlikely that your client is experiencing VPN timeouts or negotiation problems. Because the users do have connectivity for a few minutes, you don't have a firewall problem or other difficulty in making a connection to the servers.
To help diagnose the problem, make sure that the ISA logs are enabled (see this Knowledge Base article for help in configuring them) and check them for indications of problems after your client's users lose connectivity. If the logs don't reveal the problem, you will have to use a package capture utility, such as tcpdump or OmniPeek, to see where the packets are being lost.
Dig Deeper on MSPs and cybersecurity
Related Q&A from Jon Snader
Learn how to set an IP address on the network interface of a FTP/Web/mail server when a client has only one public IP address. Continue Reading
To connect to a WAN remotely, your client can use a VPN client or a leased line. Learn the pros and cons of WAN connectivity with each option, such ... Continue Reading
Learn how to configure a VPN firewall so that it works with a customer's DMZ server. Continue Reading