Slow indexing of folder tree

[RichieHakim]

Using the iPython OSF object, it is very slow to walk through a tree structure of folders in order to index the data repo.

import osfclient
client = osfclient.OSF()
proj = client.project('url_id')

def build_folder_tree(folder):
    subfolders = list(folder.folders)
    tree = {}
    for sub in subfolders:
        tree_sub = build_folder_tree(sub)
        tree[sub.name] = tree_sub
    if tree == {}:
        tree = (f for f in folder.files)
    return tree

tree = build_folder_tree(proj.storage())

Is there an easier way to build a hierarchical index of a project repo so that one can quickly

[RichieHakim]

Also finding that the files that are listed from folder.files are incorrect. It skips some files and makes redundant other files. This is a serious issue and makes the tool somewhat useless.