Welcome guest. Before posting on our computer help forum, you must register. Click here it's easy and free.

Author Topic: Large number of directories - access time (NTFS)  (Read 2526 times)

0 Members and 1 Guest are viewing this topic.

flexscan

    Topic Starter


    Starter

    Large number of directories - access time (NTFS)
    « on: December 19, 2008, 10:54:29 PM »
    From an archiving operation I have to handle a directory that contains about 80.000 sub-directories (and increasing).
    The number cannot be reduced or distributed over a larger number of sub-directories.
    Consequently, working in the directory is VERY slow, as it re-reads the directory structure after every action.

    Is there any way to speed up access to such a directory (e.g. when accessing with "Explorer" or programs such as "Total Commander") or at least optimize performance ?
    « Last Edit: December 20, 2008, 05:58:43 PM by flexscan »

    soybean



      Genius
    • The first soybean ever to learn the computer.
    • Thanked: 469
    • Computer: Specs
    • Experience: Experienced
    • OS: Windows 10
    Re: Large number of directories - access time (NTFS)
    « Reply #1 on: December 20, 2008, 02:46:53 PM »
    Not sure I can give you a good answer, but might be worth asking whether your hard drive has recently been defragmented.  Has it?

    Your OS?  How much free space (MBytes and percentage) on your hard drive? 

    patio

    • Moderator


    • Genius
    • Maud' Dib
    • Thanked: 1769
      • Yes
    • Experience: Beginner
    • OS: Windows 7
    Re: Large number of directories - access time (NTFS)
    « Reply #2 on: December 20, 2008, 04:46:23 PM »
    Also Total Commander hates indexing service and any Symantec products...
    Turn off the indexing service and if you have any Symantec products think about replacing them with (FREE ) alternative protection apps...
    There's a ton of info for this in our Virus and Spyware Forum.
    " Anyone who goes to a psychiatrist should have his head examined. "

    flexscan

      Topic Starter


      Starter

      Re: Large number of directories - access time (NTFS)
      « Reply #3 on: December 20, 2008, 05:52:22 PM »
      soybean: 
      The HDD is brand new, the archiving was the first operation done with it.
      It's a 500GB USB HDD, the current utilization is about 30GB.
      Each archived file folder (out of the 80.000) contains one or more PDF or DOC files with about 375kB in average.

      The indexing is switched on at the moment, because of the promised "faster search" results.
      Can the indexing be switched of just like that or will it affect the data on the HDD ?
      (e.g. re-format or such)

      I use the USB HDD with several PCs and Laptops running AV programs, e.g. AVIRA on the PC, but "OfficeScan" on the Laptop.
      They are all slow when accessing the archive folder containing the 80.000 sub-directories, so I assume it's not a problem of the AV program.

      OS is WinXP Home on PC and WinXP Prof. on Laptop.


      patio

      • Moderator


      • Genius
      • Maud' Dib
      • Thanked: 1769
        • Yes
      • Experience: Beginner
      • OS: Windows 7
      Re: Large number of directories - access time (NTFS)
      « Reply #4 on: December 20, 2008, 07:17:56 PM »
      When you switch off the indexing service be prepared to wait about the same amount of time as defrag or diskcheck takes...

      No guarantees here on it speeding things up but in my experience running Total Commander it liked it off.

      Your mileage may vary...
      " Anyone who goes to a psychiatrist should have his head examined. "

      flexscan

        Topic Starter


        Starter

        Re: Large number of directories - access time (NTFS)
        « Reply #5 on: December 21, 2008, 06:00:03 AM »
        so I have switched off the "Indexing Service" on the USB HDD,
        et voila, what used to be 1.5 to 2 minutes waiting time until the directory was read,
        is now reduced to about 9 seconds.
        *censored* of an improvement !

        Thanks to you guys, I am one happy user now.
        Merry Christmas.

        BTW:  The time needed to work on the HDD/directories/files to change from "Indexing" to "No index" took about 5 minutes.

        patio

        • Moderator


        • Genius
        • Maud' Dib
        • Thanked: 1769
          • Yes
        • Experience: Beginner
        • OS: Windows 7
        Re: Large number of directories - access time (NTFS)
        « Reply #6 on: December 21, 2008, 09:30:57 AM »
        Excellent !

        Enjoy the Holidays yourself as well and stop by anytime ! !
        " Anyone who goes to a psychiatrist should have his head examined. "