【问题标题】:Avoiding exceeding execution time when recursively converting Google Sheets to Excel将 Google 表格递归转换为 Excel 时避免超过执行时间
【发布时间】:2016-02-23 03:21:51
【问题描述】:

我正在编写一个脚本来遍历我的 Google Drive 中的一系列文件夹,复制文件夹结构,并将文件夹中包含的文件转换为 Excel 或 Word。

有三种可能的选择: Google 表格文件应转换为 Excel; Google Docs 文件到 Word;和其他文件应按原样复制。

我正在使用递归函数来探索文件结构。

脚本似乎可以工作,但我超出了允许的执行时间。分析执行脚本,这似乎是因为将每个 Google 文件转换为 MS-Office 文件需要大约 2 秒。

任何人都可以建议:

  • 更快的文件转换方法?
  • 一种用于跟踪递归过程在哪里进行的方法,以便我可以暂停和恢复该过程? (我也很感激一些关于如何暂停和恢复进程的建议 ;-)

抱歉,如果这已被覆盖,我确实花了一些时间寻找答案,我可以看到类似的问题,但不是我能理解的解决方案。

代码如下。

function folderRecurse(folderToSearch, folderToSave){
  while (folderToSearch){ // the function has been passed a folder to search inside
    var searchFolderId = folderToSearch.getId(); // get the Id of the folder passed
    var currentFolder = DriveApp.getFolderById(searchFolderId); //open the search folder passed
    var newName = currentFolder.getName(); // get the name of the search folder passed
    var saveFolder = folderToSave.createFolder(newName);// make a copy of the search folder in the backup folder
    var subfolders = currentFolder.getFolders(); //get any subfolders of the folder passed
      while (subfolders.hasNext()){ // if there are subfolders, start again by passing the function the folder to search and the folder to save to
      var subfolder = subfolders.next();
      folderRecurse(subfolder, saveFolder);
    }
    // when there are no more folders left, deal with the files inside the folder
    var folderFiles = folderToSearch.getFiles();
    while (folderFiles.hasNext()){
      // get the file
      var thisFile = folderFiles.next();
      // get the file's name
      var thisFileName = thisFile.getName();
      //test the file type
      var fileType = thisFile.getMimeType();
      Logger.log(fileType);
      if (fileType == "application/vnd.google-apps.document"){ // this is a google doc-- save it as a word document
        //google docs to word method
      }
      else if (fileType == "application/vnd.google-apps.spreadsheet"){ // this is a spreadsheet -- save it as an excel file
        convertToXlsxAndSave(thisFile,saveFolder)
        Logger.log(thisFile.getName());
      }
      else { // save it as whatever kind of file it is
       thisFile.makeCopy(thisFile.getName(),saveFolder);
      }
    }
    return 0;
  }
  return 0;
}

function convertToXlsxAndSave(thisFile, saveFolder){

  //open the file as an excel sheet
  var url = "https://docs.google.com/feeds/download/spreadsheets/Export?key=" + thisFile.getId() + "&exportFormat=xlsx";

  // set parameters
  var params = {
      method      : "get",
      headers     : {"Authorization": "Bearer " + ScriptApp.getOAuthToken()},
      muteHttpExceptions: true
    };

  // get the binary
  var blob = UrlFetchApp.fetch(url, params).getBlob();

  // name the binary with the fileName
  blob.setName(thisFile.getName() + ".xlsx");

  // save the binary into the proper folder
  saveFolder.createFile(blob);
}

function convertToDocxAndSave(thisFile, saveFolder){

  //open the file as a word doc sheet
  var url = "https://docs.google.com/feeds/download/documents/export/Export?id=" + thisFile.getId() + "&exportFormat=docx";

  // set parameters
  var params = {
      method      : "get",
      headers     : {"Authorization": "Bearer " + ScriptApp.getOAuthToken()},
      muteHttpExceptions: true
    };

  // get the binary
  var blob = UrlFetchApp.fetch(url, params).getBlob();

  // name the binary with the fileName
  blob.setName(thisFile.getName() + ".docx");

  // save the binary into the proper folder
  saveFolder.createFile(blob);
}


function createMsOfficeVersions() {
  // this function works through the files in the folders enumerated below, and creates MS Office versions. Eg Google Sheets convert to Excel files, Google Docs to Word files. The files are stored in a folder for downloading to AC.

  // create a date-stamped folder within the backups folder

  var formattedDate = Utilities.formatDate(new Date(), "GMT+12", "dd MMMM yyyy");

  var backupLabel = "HAMP Survey MS Office backup versions " + formattedDate;

  // get the folder Ms Office versions
  var backupDir = DriveApp.getFolderById('XXXXXXX');

  // make a new date-stamped folder to save the files into
  var thisBackup = backupDir.createFolder(backupLabel);

  // get the Survey 2015-2016 folder and subfolders
  var hampSurveyFolder = DriveApp.getFolderById('XXXXXXXXX');

  // loop through all the folders. For each, create a new folder inside the backup folder, grab all the files, test if they are docs or spreadsheets, copy to the new folder. if they are neither, copy as is.
  folderRecurse(hampSurveyFolder,thisBackup);

}

【问题讨论】:

    标签: recursion google-apps-script export-to-excel google-apps execution-time


    【解决方案1】:

    如果 Google Drive 文件夹有大量文件,脚本可能会超时。您应该改为使用基于时间的触发器,该触发器每 10 分钟运行一次并转换文件,而文件迭代器应存储为属性,以便从之前停止的地方继续。

    function myFunction() {
    
      var props = PropertiesService.getScriptProperties();
      var token = props.getProperty('TOKEN');
      var files = continuationToken ? DriveApp.continueFileIterator(token) : DriveApp.getFiles();
      var start = Date.now();
    
      while (files.hasNext() && (Date.now() - start < 5*60*1000)) {
        var file = files.next();    
        // convert files    
      }
    
      if (files.hasNext()) {
        props.setProperty("TOKEN", files.getContinuationToken());
      } else {
        props.deleteProperty("TOKEN");
      }
    }
    

    【讨论】:

    • Amit... 存储为属性的文件 id 没问题。但是如何回到子循环递归迭代步骤,除非您准确存储您正在工作的子文件夹?
    • 我认为还有一个文件夹迭代器。
    • 苏杰,说得好。但是您的评论帮助我意识到递归循环通过子文件夹的路径总是相同的,所以也许我可以存储子文件夹并在那里恢复。我目前最好的计划是运行递归来构造一个文件列表(所有文件夹中的 ID 列表),然后在转换中添加一个 if 语句以检查当前文件是否已被转换。非常慢,但是...
    • @HamishTocher 会保留状态数组有帮助吗?制作一个数组(或哈希图)以保留“文件 id”-“状态”对。处理完文件 ID 后标记为真。这样,当您重新加载时,您可以继续跳过文件并完成目录,直到遇到数组(或映射)中不存在的文件 id 并因此从该点开始。该地图将允许您轻松搜索给定的文件 ID。
    • @HamishTocher 如果在 2 次执行过程中,您对驱动器结构进行任何更改,路径会有所不同。
    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2011-09-30
    • 2020-08-25
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多