6 Replies Latest reply on Jul 25, 2016 11:12 AM by carlos

    SWD package download speed is capped (slow)

    Apprentice

      Hi all

       

      Wonder if anyone has experience this

       

      - LDMS 2016

      - Configured a distribution package with UNC share

      - Configured PPS for the read access rights

      - Created scheduled task to distribute this package over 4Mbps WAN link (via VPN)

       

      The task is able to complete but the package download speed is at approx 200kbps.

       

      Tests done after the first deployment:

      - Done a straight file copy using Remote Control's File Transfer (transfer successful at approx 3Mbps)

      - Changed agent settings --> Network Settings --> Bandwidth Throttling to 100%, the result is package download at approx 400kbps

      - Disabled Accelerated Push, disabled Peer Download, no change in download speed (approx 400Mbps)

       

      Am I missing something? Is there any other place other than Agent Settings to disable bandwidth throttling? Delivery methods used to have package delays but it should be deprecated in ver 2016? Is it co-incidental to have the download speed cap at 400kbps (which is 10% of available bandwidth)?

       

      Thanks for any help!

       

      Chyr

        • 1. Re: SWD package download speed is capped (slow)
          phoffmann SupportEmployee

          So after a bit of mulling this one over, I think I may help you get a bit more insight into what's going on potentially.

           

          First up - two article that may / will be of use to you:

           

          The reason the diagnostic logging article is important is that detailed bandwidth/download specific information is enabled only with the debug / Xtrace information enabled (the most interesting log for this would be - "sdclient_task###.log" (where ### is the task IDN) in the "C:\Program Files (x86)\LANDesk\LDClient\Data\" folder.

           

          I've whipped up a quick batch file & attached a 30 MB file to it (granted, only a single download, but you'll be able to track things across your environment to understand what's going on better with similar log entries).

           

          Here's a bunch of stuff from the log (comments from me commence with '--'s at the line. I've also added some white space to make things more readable.).

           

          NOTE - this is from the client "doing the downloading" (just to clarify).

          (...)
          -- below lines are mainly to give you an idea what strings / section this is from (near the start of a log).
          LOG    Mon, 25 Jul 2016 15:18:34 sdclientlib.dll sdclient.cpp(990) The nostatus flag has NOT been set.
          LOG    Mon, 25 Jul 2016 15:18:34 sdclientlib.dll sdclientsettings.cpp(61) Core name '192.168.110.157' obtained from the registry
          LOG    Mon, 25 Jul 2016 15:18:34 sdclientlib.dll sdclient.cpp(1035) Sending task status, cmd line -coreandip=192.168.110.157 -taskid=24 -retcode=229392444 -pkgid=23
          VRBOSE Mon, 25 Jul 2016 15:18:34 sdclientlib.dll sdclient.cpp(1039) Waiting for status to be sent (i.e. waiting for launched application to exit).
          
          --  List of files I will be downloading
          XTRACE Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4061) AddFileToDownloadSet (utf8):called with sourcePath http://SAMARKUM.fantasia.org/ldlogon/xx/Win Packages/Calc Then Notepad.bat, hash bYa9x5hzEubtnP2/swUYsw==
          XTRACE Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4061) AddFileToDownloadSet (utf8):called with sourcePath http://SAMARKUM.fantasia.org/ldlogon/xx/Win Packages/Bigger guy/BloatedFile.exe, hash DOZt+7mzJ/UCAnhUFMFoFA==
          
          -- the following lines recap the used download setting / specify what those are. In my case, 100% bandwidth for both situations.
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4602) About to call DownloadFiles (2 files) with these settings:
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4603) m_allowedBandwidthWAN: 100
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4604) m_allowedBandwidthLAN: 100
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4606) m_discardPeriodSeconds: 604800
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4607) m_preserveDirectoryStructure: 1
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4608) m_bUseWanBWForPush: 0
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4609) m_bSynchronize: 0
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4611) Allowed download methods(m_downloadControl):
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4615) PeerOneSource
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4617) Peer
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4619) Source
          LOG    Mon, 25 Jul 2016 15:18:34 lddwnld.DLL lddownload.cpp(4632) m_preferredServerControl: AttemptPreferredServer
          
          (... white space to skip some bits ...)
          
          -- About to start downloading a bigger (32-ish MB) file
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(682) curl_easy_perform failed err=22
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL lddwnldnew.cpp(983) Failed to get info for http://Samarkum.fantasia.org/ldlogon/xx/Win Packages/Bigger guy/LDHashDir/BloatedFile.exe.hash.xml
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL lddwnldnew.cpp(649) GetFileInformation called for http://Samarkum.fantasia.org/ldlogon/xx/Win Packages/Bigger guy/BloatedFile.exe
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL lddwnldnew.cpp(664) GetFileInformation - same path last=http://Samarkum.fantasia.org/ldlogon/xx/Win Packages/Bigger guy/BloatedFile.exe, time: low B9B22100 high 1C2191D, size 32241446 
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL lddwnldnew.cpp(649) GetFileInformation called for http://Samarkum.fantasia.org/ldlogon/xx/Win Packages/Bigger guy/BloatedFile.exe
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL lddwnldnew.cpp(664) GetFileInformation - same path last=http://Samarkum.fantasia.org/ldlogon/xx/Win Packages/Bigger guy/BloatedFile.exe, time: low B9B22100 high 1C2191D, size 32241446 
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL lddwnldnew.cpp(320) Discard period of 604800 will be set for this file
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL lddwnldnew.cpp(331) GetFilePrevCount returned -2 where -3 = whole file, -2 = none, and >=0 = part
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL DiskSpace.cpp(158) Checking free disk space for 'C:\Program Files (x86)\LANDesk\LDClient\sdmcache\': total free 72339816448, needed 32241446, reserved 10485760)
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL DiskSpace.cpp(163) There is sufficent available space
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(837) Downloading byte range - '0-1417999'
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Hostname was found in DNS cache
          
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(117) Curl INFO:   Trying 127.0.0.1...
          
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Connected to 127.0.0.1 (127.0.0.1) port 9592 (#2)
          
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(128) Curl REQUEST: 
          GET http://Samarkum.fantasia.org/ldlogon/xx/Win%20Packages/Bigger%20guy/BloatedFile.exe HTTP/1.1
          Range: bytes=0-1417999
          User-Agent: LANDeskDownloader
          Host: Samarkum.fantasia.org
          Accept: */*
          Proxy-Connection: Keep-Alive
          
          
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Server Microsoft-IIS/8.5 is not blacklisted
          
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Connection #2 to host 127.0.0.1 left intact
          
          -- IMPORTANT -- Time measure here. Bytes 0 through 1,417,999 (about 1.5 MB) took ~0.2 seconds.
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(971) Time to download byte range: '0-1417999' was 0.198 seconds
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(837) Downloading byte range - '1418000-2835999'
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Found bundle for host Samarkum.fantasia.org: 0x5fb228
          
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Re-using existing connection! (#2) with host 127.0.0.1
          
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Connected to 127.0.0.1 (127.0.0.1) port 9592 (#2)
          
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(128) Curl REQUEST: 
          GET http://Samarkum.fantasia.org/ldlogon/xx/Win%20Packages/Bigger%20guy/BloatedFile.exe HTTP/1.1
          Range: bytes=1418000-2835999
          User-Agent: LANDeskDownloader
          Host: Samarkum.fantasia.org
          Accept: */*
          Proxy-Connection: Keep-Alive
          
          XTRACE Mon, 25 Jul 2016 15:18:47 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Server Microsoft-IIS/8.5 is not blacklisted
          
          XTRACE Mon, 25 Jul 2016 15:18:48 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Connection #2 to host 127.0.0.1 left intact
          
          -- IMPORTANT -- Time measure here. Bytes 1,418,000 through 2,835,999 (about 1.5 MB) took ~0.04 seconds.
          XTRACE Mon, 25 Jul 2016 15:18:48 lddwnld.DLL curlhelper.cpp(971) Time to download byte range: '1418000-2835999' was 0.038 seconds
          XTRACE Mon, 25 Jul 2016 15:18:48 lddwnld.DLL curlhelper.cpp(837) Downloading byte range - '2836000-4253999'
          XTRACE Mon, 25 Jul 2016 15:18:48 lddwnld.DLL curlhelper.cpp(117) Curl INFO: Found bundle for host Samarkum.fantasia.org: 0x5fb228
          
          <... and so on ...>
          

           

          "Just in case" - I'm also attaching a set of annotated logs around Peer Download I did for someone else (again, with full debug-logging enabled) which explain what happens at what stage - from both the "serving peer" and the "downloading client" if that'll help (not really related to this immediately, but I suspect it won't hurt you to have that stuff available too ). That's "Peer-Download Annotated Logs.7z".

          1 of 1 people found this helpful
          • 2. Re: SWD package download speed is capped (slow)
            phoffmann SupportEmployee

            ... because I forgot.

             

            The 2nd link (around PEDOWNLOADER) allows you to call on our Software Distribution API's - "anything you can do" in Soft Dist, you can do with PEDownloader. Whilst its primary purpose is around Provisioning, it's a wonderfully abusable exe to call on specific SoftDist methods / control key items as needed.

            1 of 1 people found this helpful
            • 3. Re: SWD package download speed is capped (slow)
              Apprentice

              Thanks Paul!

               

              I'll give it a go.

              • 4. Re: SWD package download speed is capped (slow)
                carlos Expert

                Just thinking outloud here, if you "- Done a straight file copy using Remote Control's File Transfer (transfer successful at approx 3Mbps)"

                Doesn't this shows a problem with the VPN, router/network, and not with Software Distribution?

                • 5. Re: SWD package download speed is capped (slow)
                  Apprentice

                  Hi Carlos

                   

                  I am trying to establish if there's any bandwidth throttling happening here. We're a late comer into the infrastructure and since, there is "currently no policies on the firewall to throttle file transfers", I'll need to prove that its not related to LD agent.

                   

                  Having said that, isn't it strange that normal file transfer can achieve 3Mbps but when it is downloaded by the LD agent that its only about to achieve 10% of the speed? That's what I need to find out.

                  • 6. Re: SWD package download speed is capped (slow)
                    carlos Expert

                    I see, sorry I missed the Mbps vs Kbps.