modules/fetchgals/fetchgals.module

<?php
// $Id$

define('FG_CWD', dirname(__FILE__).'/fetchgals/');
define('FG_MAIN', dirname(__FILE__).'/fetchgals/fetchgals.pl');
define('FG_TGPS', dirname(__FILE__).'/fetchgals/findtgps.pl');

/**
 * Implementation of hook_help
 */
function fetchgals_help($section) {
  switch ($section) {
    case 'admin/modules#description': // This description is shown in the listing at admin/modules.
      return t('Integration with Fetchgals (http://fetchgals.sourceforge.net) - a webspider to download free porn');
    case 'admin/fetchgals': // Shown on the main administration screen
      return t("You *must* run 'Find Galleries' before you can use either of the other two functions.");
    case 'admin/help#fetchgals': // Some help text
      return t("<h1><a name=\"introduction\">INTRODUCTION</a></h1>
        <p>Today, commercial porn sites are advertised like this: somebody puts
        together a thumbnail gallery, i.e. a web page with small thumbnail
        pictures linking to free full-size images or movies, and provides a
        link to the pay site. These thumbnail galleries are listed on central
        websites called Thumbnail Gallery Posts (TGPs). Unfortunately, many
        TGPs add a layer of redirects, popups, spyware and viruses. <strong>Fetchgals</strong>
        is designed to eliminate the TGP middle men, to achieve a satisfying
        masturbatory experience.</p><p>The <strong>fetchgals</strong> distribution comes with
        a huge list of TGPs. This list was generated by a separate script
        called findtgps, which is also included in the distribution. <strong>Fetchgals</strong>
        visits these TGPs in order to locate thumbnail galleries. The images
        and movies of these galleries can then be downloaded. Since there's a
        couple hundred gigabytes of free porn on the internet at any given time,
        <strong>fetchgals</strong> constantly monitors local disk space to avoid overruns.
        Alternatively, <strong>fetchgals</strong> can create local HTML pages that link to the
        known galleries; this minimizes disk and bandwidth usage.</p><hr>
        <h1><a name=\"description\">DESCRIPTION</a></h1>
        <p>A <em>TGP</em> (Thumbnail Gallery Post) is a website that links to many
        <em>thumbnail galleries</em>, sites with free porn. In one kind of TGP, the
        so-called <em>CJ</em> sites (for ``circle jerk''), the viewer is sometimes
        redirected to other TGPs rather than to the gallery they intend to
        visit. Many of these CJ sites also resize and hijack the browser, try
        to install adware or dialers on the viewer's computer, open consoles
        and popups, etc.</p>
        <p><strong>Fetchgals</strong> is designed to work around these annoyances of CJ sites,
        in order to achieve a satisfying masturbatory experience. It reads
        TGP URLs from a configuration file, visits the TGPs one by one, and
        determines gallery URLs as well as a preview thumbnail for each
        gallery. This information is saved to a file and can then be used in 
        two ways: to download all the pictures from all the galleries to the
        local computer, or to create local HTML pages with preview thumbnails
        linking to the galleries.</p><hr>
        <h1><a name=\"licences + legal\">LICENCES + LEGAL</a></h1>
        <p><strong>Fetchgals</strong> is in the %link6. This means that <em>\"there are no
        laws which restrict its use by the public at large\"</em>.</p><p>This
        module is covered under the %link7.  The GPL grants certain rights, most
        importantly <em>\"the right to run the program, for any desired purpose\"
        </em>.</p>
        <p>In view of these licences, there is nothing to stop an admin from charging users to view
        the results of these programs, but please bear in mind that the content you will gain from
        using this module and the <strong>Fetchgals</strong> package may have <strong>copyright
        / Intellectual property rights</strong> and therefore you may be breaking
        the law by charging for it.</p><p>Neither Drupal.org nor the author of this module are
        responsible for the use of this module. You should be aware of the legislation applying to
        your site. <em>You can't charge for something which doesn't belong to you!</em></p><hr>
        <h1><a name=\"instructions\">INSTRUCTIONS</a></h1>
        <p>Most users will not need to change any of the settings, everything will
        work fine just from the defaults. If however you wish to make the porn
        html directory private (ie. not directly viewable from the web) then
        simply change the 'HTML Directory' setting to somewhere where normal
        users cannot access.  Of course, ensure that the webserver still has
        permissions to create files in this new location.</p>
        <p>To simply use this module to create local HTML pages with preview
        thumbnails, go to %link1 then click 'Find Galleries' followed
        by 'Create HTML'.  It *will* take a while and you can only run one
        of these processes at a time (due to the high load they put on the server) but when
        finished you can view the results on the %link3 page.</p><p>If you wish,
        you can edit the list of pages where <strong>fetchgals</strong> finds its links.  It's
        recommended not to make the list too long as you'll quickly run out of memory.
        In the <strong>fetchgals</strong> package directory you'll find a sample file called %link2
        this contains many more links you can add to your own tgps file.  Please bear
        in mind though that <strong>fetchgals</strong> hasn't been updated in quite a while and therefore some
        of these links may no longer be valid.</p><p><font size='+1'><strong>AGAIN!  DO NOT MAKE
        YOUR TGPS FILE TOO LONG ELSE YOU *WILL* RUN OUT OF MEMORY!!!</strong></font></p>
        <hr><h1><a name=\"troubleshooting\">TROUBLESHOOTING</a></h1>
        <p>Please read the %link4 file carefully.  If you still have problems then:</p>
        <p><ul>
        <li>Check your logs at: %link5  The first line is the full commandline passed to <strong>fetchgals</strong>
            and so will greatly help with debugging.</li>
        <li>If the log tells you:<p><em>\"Reading galleries and preview thumbs from
        /var/www/localhost/htdocs/modules/fetchgals/fetchgals/galleries Discarding galleries that
        have already been processed... Done with discarding. No new galleries to process. Run
        fetchgals -f first\"</em></p><p>This means that all the galleries collected in the ./galleries
        file have been processed already. <em>\"fetchgals -f\"</em> is just an abbreviated way of
        telling you to use the 'Find Galleries' function to find new galleries to process.</p></li>
        <li>The logs will also show if <strong>fetchgals</strong> rejects the arguments passed to it.  It will not however
            show errors if the command cannot be executed.  In this case, see the next step:</li>
        <li>Check your webservers error_log.  This will detail any Perl errors.</li>
        <li>Q: <em>\"Help! My porn_pics directory is completely filling up my hard drive!\"</em><br>
        A: This is because you clicked 'Download Pictures' without bothering to look at what it
        actually does...  I do agree that the default of <strong>max_disk_usage</strong> is a <em>little</em>
        on the high side at 95% (yours is set to '%var2%') but I didn't want to change any of the default settings.
        <p>To stop it, first run:</p><p><strong># ps -e</strong></p><p>You'll see a number of Perl processes running.
        If this number matches your <strong>num_download_processes</strong> (currently set to '%var1')
        then simply run:</p><p><strong># killall perl</strong></p></li>
        <li>Q: <em>\"<strong>Fetchgals</strong> doesn't work for me, it reports 'XXX' error...\"</em><br>A: I didn't write
        <strong>fetchgals</strong> please consult either the %link8 or the %link9.</li>
        <li>Q: <em>\"When I first ran <strong>Fetchgals</strong> I got over a 100 pages of galleries. Now
        when I run 'Create HTML' I only get 30 or so, even when my porn_html directory is empty?\"</em><br>A:
        <strong>Fetchgals</strong> works by storing processed information in files, this tries to prevent you
        from reprocessing galleries you've already viewed.  If however you wish to <em>'start from scratch'</em>
        you can purge these files by using the 'Cleaning Operations' in %link1.</li>
        </ul></p>
        <p>Take care if you do alter any of the settings and please use a little common sense.  If you alter
        the Gallery Filename for instance, neither 'Download Pictures' nor 'Create HTML' will work until the
        new gallery file exists.  You'll then have to re-run 'Find Galleries' to create a new gallery file
        (or rename the old one to match the new setting).</p>",
        array('%link1' => l('admin/fetchgals', 'admin/fetchgals'),
              '%link2' => l('tgps_huge', drupal_get_path('module', 'fetchgals').'/fetchgals/tgps_huge'),
              '%link3' => l('fetchgals', 'fetchgals'),
              '%link4' => l('INSTALL', drupal_get_path('module', 'fetchgals').'/INSTALL.txt'),
              '%link5' => l('admin/fetchgals/log', 'admin/fetchgals/log'),
              '%link6' => l('public domain', 'http://en.wikipedia.org/wiki/Public_domain'),
              '%link7' => l('GPL licence', 'http://en.wikipedia.org/wiki/Gpl'),
              '%link8' => l('Fetchgals README file', drupal_get_path('module', 'fetchgals').'/fetchgals/README'),
              '%link9' => l('Fetchgals site', 'http://fetchgals.sourceforge.net'),
              '%var1' => variable_get('fetchgals_num_download_processes', 8),
              '%var2' => variable_get('fetchgals_max_disk_usage', 95)
        )
      );
  }
  return $output;
} // fetchgals_help

/**
 * Implementation of hook_perm
 */
function fetchgals_perm() {
  return array('administer fetchgals', 'access fetchgals');
} // fetchgals_perm

/**
 * Implementation of hook_menu
 */
function fetchgals_menu($may_cache) {
  $items = array();
  if ($may_cache) {
    $items[] = array('path' => 'fetchgals/file',
      'callback' => 'fetchgals_file_download',
      'access' => user_access('access fetchgals'),
      'type' => MENU_CALLBACK
    );
    $items[] = array('path' => 'fetchgals/thumb',
      'callback' => 'fetchgals_show_thumb',
      'access' => user_access('access fetchgals'),
      'type' => MENU_CALLBACK
    );
    $items[] = array('path' => 'fetchgals/overlay',
      'callback' => 'fetchgals_overlay',
      'access' => user_access('access fetchgals'),
      'type' => MENU_CALLBACK
    );
    $items[] = array('path' => 'admin/fetchgals', 'title' => t('fetchgals'),
      'callback' => 'fetchgals_admin',
      'access' => user_access('administer fetchgals'),
      'type' => MENU_NORMAL_ITEM
    );
    $items[] = array('path' => 'admin/fetchgals/log', 'title' => t('fetchgals log'),
      'callback' => 'fetchgals_log',
      'access' => user_access('administer fetchgals'),
      'type' => MENU_NORMAL_ITEM
    );
    $items[] = array('path' => 'fetchgals', 'title' => t('fetchgals'),
      'callback' => 'fetchgals_view',
      'access' => user_access('access fetchgals'),
      'type' => MENU_NORMAL_ITEM
    );
    if (file_check_directory(fetchgals_check(variable_get('fetchgals_pics_dir', './porn_pics')))) {
      $items[] = array('path' => 'fetchgals/pictures', 'title' => t('fetchgals pics'),
        'callback' => 'fetchgals_viewpics',
        'access' => user_access('access fetchgals'),
        'type' => MENU_SUGGESTED_ITEM
      );
    }
  }
  return $items;
} // fetchgals_menu

/**
 * Implementation of hook_init
 */
function fetchgals_init() {
  unset($flag);
  $files = array('fetchgals.pl', 'findtgps.pl', 'tgps');
  foreach ($files as $check) {
    if (!file_exists(FG_CWD.$check)) {
      $flag = TRUE;
    }
  }
  if ($flag) {
    watchdog('fetchgals', t('Fetchgals package is not installed correctly. Please consult fetchgals/INSTALL.txt.'), WATCHDOG_ERROR);
  }
  $dir = FG_CWD;
  if (!file_check_directory($dir, FALSE)) {
    watchdog('fetchgals', t('Fetchgals directory is not writeable for the webserver. Please consult fetchgals/INSTALL.txt.'), WATCHDOG_ERROR);
  }
  return;
} // fetchgals_init

/**
 * Implementation of hook_settings
 */
function fetchgals_settings() {
  unset($version);
  $perl = exec('perl -V:version');
  $perl = explode("'", $perl);
  $perl = $perl[1];
  $form['perl_version'] = array(
    '#type' => 'item',
    '#value' => $perl ? t('<strong>Perl version:</strong> %ver', array('%ver' => $perl)) : t('Perl is not installed.'),
  );
  $version = exec('perl '.FG_MAIN.' --version');
  if ($perl) {
    $form['fg_version'] = array(
      '#type' => 'item',
      '#value' => $version ? t('<strong>%ver</strong>', array('%ver' => $version)) : t('Fetchgals package is not installed correctly.'),
    );
  }
  $dir = FG_CWD;
  if (!file_check_directory($dir, FALSE)) {
    drupal_set_message(t('Fetchgals directory is not writeable for the webserver.'), 'error');
    unset($version);
  }
  if (!$version) {
    $form['null'] = array(
      '#type' => 'item',
      '#value' => t('Please consult fetchgals/INSTALL.txt.'),
    );
    return $form;
  }
  $form['cron_settings'] = array(
    '#type' => 'fieldset',
    '#title' => t('Cron Settings:'),
    '#collapsible' => TRUE,
    '#collapsed' => FALSE,
  );
  $form['cron_settings']['fetchgals_cron'] = array(
    '#type' => 'checkbox',
    '#title' => t('Use cron to manage fetchgals?'),
    '#default_value' => variable_get('fetchgals_cron', 0),
    '#description' => t('Assuming you have your cron set up properly, checking this will automate fetchgals'),
  );
  foreach (range('0', '23') as $i) {
    $time[$i] = date('g:00a', mktime($i));
  }
  $form['cron_settings']['fetchgals_timecron'] = array(
    '#type' => 'select',
    '#title' => t('Time of day for cron'),
    '#default_value' => variable_get('fetchgals_timecron', 3),
    '#options' => $time,
    '#description' => t("Depending on what you've set below, this setting makes sure the cronjobs only execute at sensible times of the day when the extra load on your server won't affect anyone"),
  );
  $form['cron_settings']['fetchgals_fetch'] = array(
    '#type' => 'select',
    '#title' => t('How often to fetch'),
    '#default_value' => variable_get('fetchgals_fetch', 86400),
    '#options' => array(NULL => 'Never', 86400 => 'Daily', 172800 => 'Every other day', 604800 => 'Weekly'),
    '#description' => t('Runs both -find_galleries and -create_html (including all your default settings from below) during your scheduled cron job to create a completely new set of galleries'),
  );
  $form['cron_settings']['fetchgals_clean'] = array(
    '#type' => 'select',
    '#title' => t('How often to empty folder'),
    '#default_value' => variable_get('fetchgals_clean', 604800),
    '#options' => array(NULL => 'Never', 86400 => 'Daily', 172800 => 'Every other day', 604800 => 'Weekly'),
    '#description' => t("Completely removes all html files in folder '%folder' during your scheduled cron job", array('%folder' => variable_get('fetchgals_html_dir', './porn_html'))),
  );
  $form['display_settings'] = array(
    '#type' => 'fieldset',
    '#title' => t('Display Settings:'),
    '#collapsible' => TRUE,
    '#collapsed' => TRUE,
  );
  $form['display_settings']['fetchgals_paginate_pics'] = array(
    '#type' => 'select',
    '#title' => t('Picture Pagination'),
    '#default_value' => variable_get('fetchgals_paginate_pics', 50),
    '#options' => array(5 => '5', 10 => '10', 15 => '15', 25 => '25', 35 => '35', 50 => '50', 75 => '75', NULL => 'All'),
    '#description' => t("The default amount of results of pictures displayed in %link
      before they're paginated.  You should reduce this to a low number if you're
      showing them as thumbnails as the images take a little while to display",
      array('%link' => l('fetchgals pics', 'fetchgals/pictures'))
    ),
  );
  $form['display_settings']['thumbs'] = array(
    '#type' => 'fieldset',
    '#collapsed' => FALSE,
  );
  $form['display_settings']['thumbs']['fetchgals_show_thumbs'] = array(
    '#type' => 'checkbox',
    '#title' => t('Show as thumbnails?'),
    '#default_value' => variable_get('fetchgals_show_thumbs', 0),
    '#description' => t("When checked all the links in %link will be shown as thumbnails", array('%link' => l('fetchgals pics', 'fetchgals/pictures'))),
  );
  $form['display_settings']['thumbs']['fetchgals_save_thumbs'] = array(
    '#type' => 'checkbox',
    '#title' => t('Save thumbnails?'),
    '#default_value' => variable_get('fetchgals_save_thumbs', 0),
    '#description' => t("Saves the thumbnails to disk as <em>thumb-xxxfilenamexxx.jpg</em>
      to save them from having to be resized on the fly every time they're viewed (which
      takes time).<br><strong>Note:</strong> The thumb files are created the first time
      they're viewed, although I may consider one day incorporating this function into
      the cron."
    ),
  );
  $form['display_settings']['thumbs']['fetchgals_thumb_width'] = array(
    '#type' => 'textfield',
    '#title' => t('Thumbnail Max Width'),
    '#default_value' => variable_get('fetchgals_thumb_width', 150),
    '#size' => 4,
    '#description' => t('in pixels'),
  );
  $form['display_settings']['thumbs']['fetchgals_thumb_height'] = array(
    '#type' => 'textfield',
    '#title' => t('Thumbnail Max Height'),
    '#default_value' => variable_get('fetchgals_thumb_height', 100),
    '#size' => 4,
    '#description' => t('in pixels'),
  );
  $form['fetchgals_settings'] = array(
    '#type' => 'fieldset',
    '#title' => t('Fetchgals Settings:'),
    '#description' => t("<h1><em>Only change these settings if you absolutely know what you're doing!</em></h1>
      <br>Note: Any directory prefixed by '<strong>./</strong>' will appear in your <em>%dir</em> directory, other than
      that please use FULL paths eg. <em>/tmp/porn_pics</em>",
      array('%dir' => drupal_get_path('module', 'fetchgals').'/fetchgals')
    ),
    '#collapsible' => TRUE,
    '#collapsed' => TRUE,
  );
  $form['fetchgals_settings']['fetchgals_tgp_file'] = array(
    '#type' => 'textfield',
    '#title' => t('TGP File'),
    '#default_value' => variable_get('fetchgals_tgp_file', './tgps'),
    '#size' => 50,
    '#description' => t("The file that contains URLs of TGPs, one per line; lines starting with
      # are comments and are ignored. Defaults to <em>./tgps</em>. This option is
      only needed by the <strong>-find_galleries</strong> action.
      <p>Two TGP files are distributed with <strong>fetchgals</strong>. Others can be
      generated with the program <em>findtgps(1)</em>.</p>"
    ),
  );
  $form['fetchgals_settings']['fetchgals_extensive_search'] = array(
    '#type' => 'checkbox',
    '#title' => t('Extensive Search'),
    '#default_value' => variable_get('fetchgals_extensive_search', 0),
    '#description' => t("This option affects the operation of the <strong>-find_galleries</strong> action.
      Without it, only links from TGPs are investigated that expose the true
      location of the gallery in the URL. If <strong>-extensive_search</strong> is
      switched on, other links are followed as well; they have to be ``tried
      out'' to find the gallery's location, and often this has to be repeated
      several times until the gallery's URL is found. The <strong>-find_galleries</strong>
      action is much slower when <strong>-extensive_search</strong> is switched on, and
      for most users it is probably not worth it."
    ),
  );
  $form['fetchgals_settings']['fetchgals_attempts_per_link'] = array(
    '#type' => 'textfield',
    '#title' => t('Attempts Per Link'),
    '#default_value' => variable_get('fetchgals_attempts_per_link', 5),
    '#size' => 5,
    '#description' => t("The number of times a link to a gallery is followed (default: 5). Many
      TGPs use CGI scripts as links to the galleries, and these scripts
      frequently redirect to another TGP rather than to the gallery. If this
      happens to us, we try the link again, until we find a <em>bona fide</em>
      gallery or we exceed num attempts. This option only has an effect if
      <strong>-extensive_search</strong> is being used."
    ),
  );
  $form['fetchgals_settings']['fetchgals_sleep_time'] = array(
    '#type' => 'textfield',
    '#title' => t('Sleep Time'),
    '#default_value' => variable_get('fetchgals_sleep_time', 7),
    '#size' => 5,
    '#description' => t("The average time (in seconds) between accesses to the same TGP
      (default is 7). This is an average; the actual waiting time is
      randomized. The purpose is to avoid our bot being detected. We cycle
      through the TGPs so that we don't have to sleep often.
      <p>This option only affects the <strong>-find_galleries</strong> action if the
      <strong>-extensive_search</strong> option is switched on. Without
      <strong>-extensive_search</strong>, we never have to sleep. If you get many ``bot
      detected'' messages during the <strong>-find_galleries</strong> action, you need to
      increase the sleep time.</p>"
    ),
  );
  $form['fetchgals_settings']['fetchgals_gallery_file'] = array(
    '#type' => 'textfield',
    '#title' => t('Gallery File'),
    '#default_value' => variable_get('fetchgals_gallery_file', './galleries'),
    '#size' => 50,
    '#description' => t("The file that contains URLs of galleries and preview thumbnails, one
      gallery and one thumbnail per line, separated by a space. Defaults to
      <em>./galleries</em>. Before the <strong>-find_galleries</strong> action starts to collect
      galleries, it reads this file so that it won't have to test a
      previously seen gallery. It then appends newly found galleries. The
      file is read by the <strong>-create_html</strong> and <strong>-download_pics</strong> actions.
      <p>If the file doesn't exist, then it will be created.</p>"
    ),
  );
  $form['fetchgals_settings']['fetchgals_use_cookies'] = array(
    '#type' => 'checkbox',
    '#title' => t('Use Cookies'),
    '#default_value' => variable_get('fetchgals_use_cookies', 0),
    '#description' => t("With this option, <strong>fetchgals</strong> will save the cookies it receives
      and return them to TGPs and galleries. By default, cookies are not
      used."
    ),
  );
  $form['fetchgals_settings']['fetchgals_pics_dir'] = array(
    '#type' => 'textfield',
    '#title' => t('Pictures Directory'),
    '#default_value' => variable_get('fetchgals_pics_dir', './porn_pics'),
    '#size' => 50,
    '#description' => t("The directory where the <strong>-download_pics</strong> action stores the downloaded
      images. Defaults to <em>./porn_pics</em>. The directory will be created if it
      doesn't exist. The pictures receive names indicating their origin and
      are stored in subdirectories a-z depending on the first letter of
      their name."
    ),
  );
  $form['fetchgals_settings']['fetchgals_processed_downloads_file'] = array(
    '#type' => 'textfield',
    '#title' => t('Processed Downloads File'),
    '#default_value' => variable_get('fetchgals_processed_downloads_file', './gals_downloaded'),
    '#size' => 50,
    '#description' => t("The file where the URLs of downloaded galleries are recorded. Defaults
      to <em>./gals_downloaded</em>. This is only used by the <strong>-download_pics</strong>
      action, to avoid repeated downloads of the same gallery. The file will
      be created if it doesn't exist."
    ),
  );
  $form['fetchgals_settings']['fetchgals_types'] = array(
    '#type' => 'textfield',
    '#title' => t('Types'),
    '#default_value' => variable_get('fetchgals_types', 'jpg|jpeg|gif|png|mpg|mpeg|avi|asf|mov|wmv'),
    '#size' => 100,
    '#description' => t("A regular expression matching the extensions of files you want to
      download. Defaults to jpg|jpeg|gif|png|mpg|mpeg|avi|asf|mov|wmv.
      The match is case-insensitive, so you don't need to list the
      upper-case variants. Note that if you want to download videos, you
      need to increase <strong>-max_img_size</strong>."
    ),
  );
  $form['fetchgals_settings']['fetchgals_min_img_size'] = array(
    '#type' => 'textfield',
    '#title' => t('Minimum Image Size'),
    '#default_value' => variable_get('fetchgals_min_img_size', 15000),
    '#size' => 10,
    '#description' => t("The minimum size (in bytes) of image files to download (default:
      15000). This is only used by the <strong>-download_pics</strong> action; files
      smaller than this threshold are taken to be thumbnails or advertising
      banners and not downloaded."
    ),
  );
  $form['fetchgals_settings']['fetchgals_max_img_size'] = array(
    '#type' => 'textfield',
    '#title' => t('Maximum Image Size'),
    '#default_value' => variable_get('fetchgals_max_img_size', 250000),
    '#size' => 10,
    '#description' => t("The maximum size (in bytes) of image files to download (default:
      250000). This is only used by the <strong>-download_pics</strong> action; files
      larger than this threshold are not downloaded. If you are interested
      in movies, you want to set this to 10000000."
    ),

  );
  $form['fetchgals_settings']['fetchgals_max_disk_usage'] = array(
    '#type' => 'textfield',
    '#title' => t('Maximum Disk Usage'),
    '#default_value' => variable_get('fetchgals_max_disk_usage', 95),
    '#size' => 4,
    '#description' => t("The image download is stopped if the disk usage exceeds <em>num</em>%
      (default: 95). This percentage is based on the total disk space
      available to non-superusers. Your system may reserve some additional
      disk space for the super user."
    ),
  );
  $form['fetchgals_settings']['fetchgals_pic_file_template'] = array(
    '#type' => 'textfield',
    '#title' => t('Picture File Template'),
    '#default_value' => variable_get('fetchgals_pic_file_template', '%i/%h-%p-%n%e'),
    '#size' => 40,
    '#description' => t("The template to be used for the filenames of the downloaded images. This is a string containing the following special place holdersq:<p>
      <dl><dt><strong>%h</strong></dt><dd>The host name of the gallery, with leading ``www.'' removed.</dd>
      <dt><strong>%i</strong></dt><dd>The first letter of the host name, or ``z'' if that is a digit. </dd>
      <dt><strong>%p</strong></dt><dd>The path of the gallery's URL, with all slashes replaced by hyphens.</dd>
      <dt><strong>%d</strong></dt><dd>The current date.</dd>
      <dt><strong>%t</strong></dt><dd>The current time.</dd>
      <dt><strong>%n</strong></dt><dd>The number of the image within the gallery.</dd>
      <dt><strong>%c</strong></dt><dd>The filetype: either ``video'' or ``image''. Note that if you want
      <strong>fetchgals</strong> to download videos, you need to increase the default
      maximal file size with <strong>-max_img_size</strong>.</dd>
      <dt><strong>%e</strong></dt><dd>The filename extension giving the file's type. Starts with a period.</dd>
      <dt><strong>%%</strong></dt><dd>A literal %-sign.</dd></dl></p>
      <p>The default template is %i/%h-%p-%n%e. Every template should contain %h, %p and %n, or else some images run the risk of being overwritten.</p>"
    ),
  );
  $form['fetchgals_settings']['fetchgals_num_download_processes'] = array(
    '#type' => 'textfield',
    '#title' => t('Number of Download Processes'),
    '#default_value' => variable_get('fetchgals_num_download_processes', 8),
    '#size' => 4,
    '#description' => t("The number of parallel processes used to download pictures (default:
      8). This only affects the <strong>-download_pics</strong> action.
      <p>We use parallel processes because today's cable and DSL internet
      connections allow much faster downloads than a single porn host can
      provide. Experiment with this number until your download speeds
      approach the bandwidth of your internet connection.</p>"
    ),
  );
  $form['fetchgals_settings']['fetchgals_html_dir'] = array(
    '#type' => 'textfield',
    '#title' => t('HTML Directory'),
    '#default_value' => variable_get('fetchgals_html_dir', './porn_html'),
    '#size' => 50,
    '#description' => t("The directory where the <strong>-create_html</strong> action creates the HTML files.
      Defaults to <em>./porn_html</em>. The directory will be created if it
      doesn't exist. The file <em>index.html</em> in that directory links to the
      other created HTML files."
    ),
  );
  $form['fetchgals_settings']['fetchgals_thumbs_per_row'] = array(
    '#type' => 'textfield',
    '#title' => t('Thumbs Per Row'),
    '#default_value' => variable_get('fetchgals_thumbs_per_row', 6),
    '#size' => 4,
    '#description' => t("The number of thumbnail pictures that will be put in one horizontal
      row of the resulting HTML file. Defaults to 6. Only used by the
      <strong>-create_html</strong> action."
    ),
  );
  $form['fetchgals_settings']['fetchgals_rows_per_file'] = array(
    '#type' => 'textfield',
    '#title' => t('Number of Rows Per File'),
    '#default_value' => variable_get('fetchgals_rows_per_file', 10),
    '#size' => 4,
    '#description' => t("The number of rows that we be put in each of the resulting HTML files.
      Defaults to 10. Only used by the <strong>-create_html</strong> action."
    ),
  );
  $form['fetchgals_settings']['fetchgals_processed_html_file'] = array(
    '#type' => 'textfield',
    '#title' => t('Processed HTML File'),
    '#default_value' => variable_get('fetchgals_processed_html_file', './gals_processed_html'),
    '#size' => 50,
    '#description' => t("The file where the URLs of galleries are recorded that have been
      processed with the <strong>-create_html</strong> action. Defaults to
      <em>./gals_processed_html</em>. This is only used by the <strong>-download_pics</strong>
      action, to avoid repeated downloads of the same gallery. The file will
      be created if it doesn't exist."
    ),
  );
  $form['findtgps_settings'] = array(
    '#type' => 'fieldset',
    '#title' => t('FindTGPS Settings:'),
    '#description' => t("<h1><em>Only change these settings if you absolutely know what you're doing!</em></h1>"),
    '#collapsible' => TRUE,
    '#collapsed' => TRUE,
  );
  $form['findtgps_settings']['findtgps_in'] = array(
    '#type' => 'textfield',
    '#title' => t("'In' File"),
    '#default_value' => variable_get('findtgps_in', './tgps'),
    '#size' => 50,
    '#description' => t("<p>Given a file <em>infile</em> containing URLs of TGPs, one per line,
      <strong>findtgps</strong> will follow links from those TGPs in order to find others.
      All found TGPs will be stored in <em>outfile</em>. Both <em>infile</em> and
      <em>outfile</em> have to be specified; they may be identical, but <em>outfile</em>
      will be overwritten.</p>
      <p>Along with the URL, <strong>findtgps</strong> will record three numbers in <em>outfile</em>:
      the number of gallery links that expose the URL, the number of
      potential gallery links that go through a CGI script, and the number of direct links to galleries. The links through CGI scripts are the most inconvenient to deal with.</p>
      <p>The purpose of <strong>findtgps</strong> is to create an input file for <em>fetchgals(1)</em>.</p>"
    ),
  );
  $form['findtgps_settings']['findtgps_out'] = array(
    '#type' => 'textfield',
    '#title' => t("'Out' File"),
    '#default_value' => variable_get('findtgps_out', './tgps'),
    '#size' => 50,
    '#description' => t("See above."),
  );
  $form['findtgps_settings']['findtgps_known_tgps'] = array(
    '#type' => 'textfield',
    '#title' => t('Known TGPS'),
    '#default_value' => variable_get('findtgps_known_tgps', './tgps'),
    '#size' => 50,
    '#description' => t("This is a file of known TGPS, one per line, which don't need to be checked again."),
  );
  $form['findtgps_settings']['findtgps_link_threshold'] = array(
    '#type' => 'textfield',
    '#title' => t('Link Threshold'),
    '#default_value' => variable_get('findtgps_link_threshold', 30),
    '#size' => 4,
    '#description' => t("The number of external links a page needs to contain before we classify it as a TGP. Default is 30."),
  );
  $form['findtgps_settings']['findtgps_fraction_followed'] = array(
    '#type' => 'textfield',
    '#title' => t('Fraction Followed'),
    '#default_value' => variable_get('findtgps_fraction_followed', 6),
    '#size' => 4,
    '#description' => t("If we have located a TGP, we will follow every <em>num</em>'th link to find
      new TGPs. Default is 6. One might be inclined to use
      <strong>-fraction_followed</strong> 1, but this is not advisable since TGPs usually
      link (through a CGI script) to only a small number of other TGPs."
    ),
  );
  $form['findtgps_settings']['findtgps_threads'] = array(
    '#type' => 'textfield',
    '#title' => t('Threads'),
    '#default_value' => variable_get('findtgps_threads', 8),
    '#size' => 4,
    '#description' => t("The number of parallel threads used for the task. Defaults to 8."),
  );
  return $form;
} // fetchgals_settings

/**
 * Displays the administrating screen.
 */
function fetchgals_admin() {
  if (fetchgals_process(variable_get('fetchgals_pid', 0))) {
    $form['null'] = array(
      '#type' => 'item',
      '#description' => t('<h2>A fetchgals process is currently running.</h2>'),
    );
  }
  $form['clean'] = array(
    '#type' => 'fieldset',
    '#title' => t('Cleaning Operations:'),
    '#collapsible' => TRUE,
    '#collapsed' => TRUE,
  );
  $form['clean']['submit6'] = array(
    '#type' => 'submit',
    '#value' => t('Clean Galleries File'),
  );
  $form['clean']['submit7'] = array(
    '#type' => 'submit',
    '#value' => t('Clean Gals Downloaded File'),
  );
  $form['clean']['submit8'] = array(
    '#type' => 'submit',
    '#value' => t('Clean Gals Processed File'),
  );
  $form['clean']['item1'] = array(
    '#type' => 'item',
    '#description' => t("<dl><dt><strong><a name=\"item_%2e%2fgalleries\"><em>%var1</em></a></strong></dt>
      <dd>This file is created by <strong>fetchgals</strong> and contains gallery URLs and
      corresponding preview thumbnail URLs and descriptive text, one gallery
      and one thumbnail and one text per line, separated by '|'. The purpose
      of the file is to record the galleries that have already been found,
      so that they are not processed again during a later invocation of
      <strong>fetchgals</strong>. The file's contents may also be useful for other
      programs. The default file name can be overridden with the
      <strong>-gallery_file</strong> option.</dd>
      <p></p>
      <dt><strong><a name=\"item_%2e%2fgals_downloaded\"><em>%var2</em></a></strong></dt>
      <dd>This file contains a list of those galleries whose pictures have been
      completely downloaded to the local computer. This allows to interrupt
      a download and resume later. Also, if <strong>fetchgals</strong> is run again and
      finds new galleries, only those not contained in this file will be
      downloaded by the <strong>-download_pics</strong> option. The default file name can
      be overridden with the <strong>-processed_downloads_file</strong> option.</dd>
      <p></p>
      <dt><strong><a name=\"item_%2e%2fgals_processed_html\"><em>%var3</em></a></strong></dt>
      <dd>This file contains a list of those galleries for which HTML pages have
      been created on the local computer. If <strong>fetchgals</strong> is run again and
      finds new galleries, only those not contained in this file will be
      processsed by the <strong>-create_html</strong> option. The default file name can be
      overridden with the <strong>-processed_html_file</strong> option.</dd></dl>",
      array('%var1' => variable_get('fetchgals_gallery_file', './galleries'),
            '%var2' => variable_get('fetchgals_processed_downloads_file', './gals_downloaded'),
            '%var3' => variable_get('fetchgals_processed_html_file', './gals_processed_html')
      )
    ),
  );
  $form['clean']['submit9'] = array(
    '#type' => 'submit',
    '#value' => t('Purge HTML Directory'),
  );
//  $form['clean']['submit10'] = array(
//    '#type' => 'submit',
//    '#value' => t('Purge Pictures Directory'),
//  );
  $form['clean']['item2'] = array(
    '#type' => 'item',
    '#description' => t("<dl><dt><strong><a name=\"item_%2dhtml_dir_dir\"><em>%dir1</em></a></strong></dt>
      <dd>The directory where the <strong>-create_html</strong> action creates the HTML files.
      Defaults to <em>./porn_html</em>. The directory will be created if it
      doesn't exist. The file <em>index.html</em> in that directory links to the
      other created HTML files.</dd></dl>",
      array('%dir1' => variable_get('fetchgals_html_dir', './porn_html'),
            '%dir2' => variable_get('fetchgals_pics_dir', './porn_pics'))
    ),
  );
  $form['find_galleries'] = array(
    '#type' => 'fieldset',
  );
  $form['find_galleries']['submit1'] = array(
    '#type' => 'submit',
    '#value' => t('Find Galleries'),
  );
  $form['find_galleries']['item'] = array(
    '#type' => 'item',
    '#description' => t("Reads a list of TGP URLs from the file specified with <strong>-tgp_file</strong>
      (default: <em>./tgps</em>) and tries to locate all thumbnail galleries
      that are linked from these TGPs. The URLs of these galleries, together with
      URLs for preview thumbnails, are then written to the file specified
      with <strong>-gallery_file</strong> (default: <em>./galleries</em>)."
    ),
  );
  $form['download_pics'] = array(
    '#type' => 'fieldset',
  );
  $form['download_pics']['submit2'] = array(
    '#type' => 'submit',
    '#value' => t('Download Pictures'),
  );
  $form['download_pics']['item'] = array(
    '#type' => 'item',
    '#description' => t("Reads a list of galleries from the file specified with
      <strong>-gallery_file</strong> (default: <em>./galleries</em>) and downloads all the
      pictures linked from those galleries. The pictures are stored in the
      directory specifed with <strong>-pics_dir</strong> (default: <em>./porn_pics</em>).
      <p>You need to run <strong>-find_galleries</strong> at least once before you can run
      <strong>-download_pics</strong>.</p>
      <p>The URLs of the galleries all of whose pictures have been completely
      downloaded are recorded in the file specified with
      <strong>-processed_downloads_file</strong> (default: <em>./gals_downloaded</em>). Because
      of this, the program never downloads the same gallery twice, and it is
      able to resume a download after it was interrupted.</p>"
    ),
  );
  $form['create_html'] = array(
    '#type' => 'fieldset',
  );
  $form['create_html']['submit3'] = array(
    '#type' => 'submit',
    '#value' => t('Create HTML'),
  );
  $form['create_html']['item'] = array(
    '#type' => 'item',
    '#description' => t("Reads a list of galleries and associated preview thumbnails from the
      file specified with <strong>-gallery_file</strong> (default: <em>./galleries</em>) and
      creates a set of HTML files that link to these galleries. The HTML
      files are created in the directory specified with <strong>-html_dir</strong>
      (default: <em>./porn_html</em>). Neither the thumbnails nor the galleries
      are downloaded, so this actions is much faster than <strong>-download_pics</strong>
      and uses up only very little local storage space.</p>
      <p>You need to run <strong>-find_galleries</strong> at least once before you can run
      <strong>-create_html</strong>.</p>
      <p>The URLs of the galleries for which local HTML files have been created
      are recorded in the file specified with <strong>-processed_html_file</strong>
      (default: <em>./gals_processed_html</em>). This is so that the program only
      produces HTML files for the most recently found galleries.</p>"
    ),
  );
  $form['tgps'] = array(
    '#type' => 'fieldset',
    '#title' => t('TGPS File:'),
  );
  $form['tgps']['submit4'] = array(
    '#type' => 'submit',
    '#value' => t('Execute FindTGPS'),
  );
  $form['tgps']['fetchgals_tgps'] = array(
    '#type' => 'textarea',
    '#title' => "The main input file, containing TGP URLs, one per line. The ``http://'' is optional. Lines starting with # are ignored",
    '#default_value' => file_get_contents(fetchgals_check(variable_get('fetchgals_tgp_file', './tgps'))),
    '#cols' => 80,
    '#rows' => 150,
    '#attributes' => is_writeable(fetchgals_check(variable_get('fetchgals_tgp_file', './tgps'))) ? '' : array('disabled' => TRUE),
  );
  if (is_writeable(fetchgals_check(variable_get('fetchgals_tgp_file', './tgps')))) {
    $form['tgps']['submit5'] = array(
      '#type' => 'submit',
      '#value' => t('Edit TGPS'),
    );
  }
  $output .= drupal_get_form('fetchgals_admin', $form);
  return $output;
} // fetchgals_admin

/**
 * Submit function for fetchgals_admin form
 */
function fetchgals_admin_submit($form_id, $form) {
  switch ($_POST['op']) {
    case "Find Galleries":
      fetchgals_find_galleries();
      break;
    case "Download Pictures":
      fetchgals_download_pics();
      break;
    case "Create HTML":
      fetchgals_create_html();
      break;
    case "Execute FindTGPS":
      fetchgals_findtgps();
      break;
    case "Edit TGPS":
      fetchgals_edit_tgps($form['fetchgals_tgps']);
      break;
    case "Clean Galleries File":
      fetchgals_clean_file(variable_get('fetchgals_gallery_file', './galleries'));
      break;
    case "Clean Gals Downloaded File":
      fetchgals_clean_file(variable_get('fetchgals_processed_downloads_file', './gals_downloaded'));
      break;
    case "Clean Gals Processed File":
      fetchgals_clean_file(variable_get('fetchgals_processed_html_file', './gals_processed_html'));
      break;
    case "Purge HTML Directory":
      fetchgals_clean_dir('html_dir');
      break;
    case "Purge Pictures Directory":
      fetchgals_clean_dir('porn_pics');
      break;
  }
  return;
} // fetchgals_admin_submit

/**
 * Function to manually edit TGPS file
 */
function fetchgals_edit_tgps($edit) {
  $output = file_put_contents(fetchgals_check(variable_get('fetchgals_tgp_file', './tgps')), $edit);
  if (!$output) {
    drupal_set_message(t('TGPS file update Failed'));
  }
  else {
    drupal_set_message(t('TGPS file successfully updated'));
  }
  return;
} // fetchgals_edit_tgps

/**
 * Creates and submits the find_galleries function
 */
function fetchgals_find_galleries() {
  if (fetchgals_process(variable_get('fetchgals_pid', 0))) {
    drupal_set_message(t('Another fetchgals process is currently running, please wait for it to finish'), 'error');
    return;
  }
  if (!file_exists(fetchgals_check(variable_get('fetchgals_tgp_file', './tgps')))) {
    drupal_set_message(t("'%gal' file is missing or not readable by the server", array('%gal' => variable_get('fetchgals_tgp_file', './tgps'))), 'error');
    return;
  }
  $dir = FG_CWD;
  if (!file_check_directory($dir, FALSE)) {
    drupal_set_message(t('Fetchgals directory is not writeable for the webserver. Please consult fetchgals/INSTALL.txt.'), 'error');
  }
  fetchgals_clear_log();
  $args = ' -find_galleries';
  $args .= ' -tgp_file '.fetchgals_check(variable_get('fetchgals_tgp_file', './tgps'));
  variable_get('fetchgals_extensive_search', 0) ? $args .= ' -extensive_search' : '';
  variable_get('fetchgals_extensive_search', 0) ? $args .= ' -attempts_per_link '.variable_get('fetchgals_attempts_per_link', 5) : '';
  variable_get('fetchgals_extensive_search', 0) ? $args .= ' -sleep_time '.variable_get('fetchgals_sleep_time', 7) : '';
  $args .= ' -gallery_file '.fetchgals_check(variable_get('fetchgals_gallery_file', './galleries'));
  variable_get('fetchgals_use_cookies', 0) ? $args .= ' -use_cookies' : '';
  fetchgals_write_log('\'Find Galleries\' process started: '.date(variable_get('date_format_long', 'l, F j, Y - H:i')).'<br />perl '.FG_MAIN.$args.' >> '.FG_CWD.'log & echo $!');
  $fetchgals_pid = shell_exec('perl '.FG_MAIN.$args.' >> '.FG_CWD.'log & echo $!');
  if (!$fetchgals_pid) {
    drupal_set_message(t('Find Galleries Failed'), 'error');
  }
  else {
    drupal_set_message(t('Find Galleries function started'));
    variable_set('fetchgals_pid', $fetchgals_pid);
  }
  return;
} // fetchgals_find_galleries

/**
 * Creates and submits the download_pics function
 */
function fetchgals_download_pics() {
  if (fetchgals_process(variable_get('fetchgals_pid', 0))) {
    drupal_set_message(t('Another fetchgals process is currently running, please wait for it to finish'), 'error');
    return;
  }
  if (!file_exists(fetchgals_check(variable_get('fetchgals_gallery_file', './galleries')))) {
    drupal_set_message(t("'%gal' file is missing, please run 'Find Galleries' first", array('%gal' => variable_get('fetchgals_gallery_file', './galleries'))), 'error');
    return;
  }
  $dir = FG_CWD;
  if (!file_check_directory($dir, FALSE)) {
    drupal_set_message(t('Fetchgals directory is not writeable for the webserver. Please consult fetchgals/INSTALL.txt.'), 'error');
  }
  fetchgals_clear_log();
  $args = ' -download_pics';
  $args .= ' -gallery_file '.fetchgals_check(variable_get('fetchgals_gallery_file', './galleries'));
  $args .= ' -pics_dir '.fetchgals_check(variable_get('fetchgals_pics_dir', './porn_pics'));
  $args .= ' -processed_downloads_file '.fetchgals_check(variable_get('fetchgals_processed_downloads_file', './gals_downloaded'));
  $args .= ' -types "'.variable_get('fetchgals_types', 'jpg|jpeg|gif|png|mpg|mpeg|avi|asf|mov|wmv').'"';
  $args .= ' -min_img_size '.variable_get('fetchgals_min_img_size', 15000);
  $args .= ' -max_img_size '.variable_get('fetchgals_max_img_size', 250000);
  $args .= ' -max_disk_usage '.variable_get('fetchgals_max_disk_usage', 95);
  $args .= ' -pic_file_template '.variable_get('fetchgals_pic_file_template', '%i/%h-%p-%n%e');
  $args .= ' -num_download_processes '.variable_get('fetchgals_num_download_processes', 8);
  $args .= ' -processed_html_file '.fetchgals_check(variable_get('fetchgals_processed_html_file', './gals_processed_html'));
  fetchgals_write_log('\'Download Pictures\' process started: '.date(variable_get('date_format_long', 'l, F j, Y - H:i')).'<br />perl '.FG_MAIN.$args.' >> '.FG_CWD.'log & echo $!');
  $fetchgals_pid = shell_exec('perl '.FG_MAIN.$args.' >> '.FG_CWD.'log & echo $!');
  if (!$fetchgals_pid) {
    drupal_set_message(t('Download Pictures Failed'), 'error');
  }
  else {
    drupal_set_message(t('Download Pictures function started'));
    variable_set('fetchgals_pid', $fetchgals_pid);
  }
  return;
} // fetchgals_download_pics

/**
 * Creates and submits the create_html function
 */
function fetchgals_create_html() {
  if (fetchgals_process(variable_get('fetchgals_pid', 0))) {
    drupal_set_message(t('Another fetchgals process is currently running, please wait for it to finish'), 'error');
    return;
  }
  if (!file_exists(fetchgals_check(variable_get('fetchgals_gallery_file', './galleries')))) {
    drupal_set_message(t("'%gal' file is missing, please run 'Find Galleries' first", array('%gal' => variable_get('fetchgals_gallery_file', './galleries'))), 'error');
    return;
  }
  $dir = FG_CWD;
  if (!file_check_directory($dir, FALSE)) {
    drupal_set_message(t('Fetchgals directory is not writeable for the webserver. Please consult fetchgals/INSTALL.txt.'), 'error');
  }
  fetchgals_clear_log();
  $args = ' -create_html';
  $args .= ' -gallery_file '.fetchgals_check(variable_get('fetchgals_gallery_file', './galleries'));
  $args .= ' -html_dir '.fetchgals_check(variable_get('fetchgals_html_dir', './porn_html'));
  $args .= ' -thumbs_per_row '.variable_get('fetchgals_thumbs_per_row', 6);
  $args .= ' -rows_per_file '.variable_get('fetchgals_rows_per_file', 10);
  $args .= ' -processed_html_file '.fetchgals_check(variable_get('fetchgals_processed_html_file', './gals_processed_html'));
  fetchgals_write_log('\'Create HTML\' process started: '.date(variable_get('date_format_long', 'l, F j, Y - H:i')).'<br />perl '.FG_MAIN.$args.' >> '.FG_CWD.'log & echo $!');
  $fetchgals_pid = shell_exec('perl '.FG_MAIN.$args.' >> '.FG_CWD.'log & echo $!');
  if (!$fetchgals_pid) {
    drupal_set_message(t('Create HTML Failed'), 'error');
  }
  else {
    drupal_set_message(t('Create HTML function started'));
    variable_set('fetchgals_pid', $fetchgals_pid);
  }
  return;
} // fetchgals_create_html

/**
 * Replaces ./ with the full path
 */
function fetchgals_check($input) {
  if (strpos($input, './') === 0) {
    $input = FG_CWD.substr($input, 2);
  }
  return $input;
} // fetchgals_check

/**
 * Executes the findtgps program
 */
function fetchgals_findtgps() {
  if (fetchgals_process(variable_get('fetchgals_pid', 0))) {
    drupal_set_message(t('Another fetchgals process is currently running, please wait for it to finish'), 'error');
    return;
  }
  if (!file_exists(fetchgals_check(variable_get('findtgps_in', './tgps')))) {
    drupal_set_message(t("'%gal' file is missing or not readable by the server", array('%gal' => variable_get('findtgps_in', './tgps'))), 'error');
    return;
  }
  $dir = FG_CWD;
  if (!file_check_directory($dir, FALSE)) {
    drupal_set_message(t('Fetchgals directory is not writeable for the webserver. Please consult fetchgals/INSTALL.txt.'), 'error');
  }
  fetchgals_clear_log();
  $args = ' -in '.fetchgals_check(variable_get('findtgps_in', './tgps'));
  $args .= ' -out '.fetchgals_check(variable_get('findtgps_out', './tgps'));
  $args .= ' -known_tgps '.fetchgals_check(variable_get('findtgps_known_tgps', './tgps'));
  $args .= ' -link_threshold '.variable_get('findtgps_link_threshold', 30);
  $args .= ' -fraction_followed '.variable_get('findtgps_fraction_followed', 6);
  $args .= ' -threads '.variable_get('findtgps_threads', 8);
  fetchgals_write_log('\'Find TGPS\' process started: '.date(variable_get('date_format_long', 'l, F j, Y - H:i')).'<br />perl '.FG_TGPS.$args.' >> '.FG_CWD.'log & echo $!');
  $fetchgals_pid = shell_exec('perl '.FG_TGPS.$args.' >> '.FG_CWD.'log & echo $!');
  if (!$fetchgals_pid) {
    drupal_set_message(t('FindTGPS Failed'), 'error');
  }
  else {
    drupal_set_message(t('FindTGPS function started'));
    variable_set('fetchgals_pid', $fetchgals_pid);
  }
  return;
} // fetchgals_findtgps

/**
 * View the created pages
 */
function fetchgals_view($page = '') {
  unset($flag);
  if (!$page) {
    $page = 'index.html';
    $flag = TRUE;
  }
  $output = file_get_contents(fetchgals_check(variable_get('fetchgals_html_dir', './porn_html')).'/'.$page);
  if (!$output) {
    drupal_set_message(t('Fetchgals HTML files do not exist.'), 'error');
    watchdog('fetchgals', t('Fetchgals HTML files do not exist.'), WATCHDOG_ERROR);
    return FALSE;
  }
  if ($flag) {
    $output = str_replace('<li><a href="', '<li><a href="fetchgals/', $output);
  }
  return $output;
} // fetchgals_view

/**
 * Empties the log file
 */
function fetchgals_clear_log() {
  $output = file_put_contents(FG_CWD.'log', '');
  return;
} // fetchgals_clear_log

/**
 * Writes to the log file
 */
function fetchgals_write_log($log) {
  $output = file_put_contents(FG_CWD.'log', $log.'<p>');
  return;
} // fetchgals_write_log

/**
 * Verifies if a process is running in linux
 */
function fetchgals_process($PID) {
  exec("ps $PID", $ProcessState);
  return(count($ProcessState) >= 2);
} // fetchgals_process

/**
 * Views the log file
 */
function fetchgals_log() {
  if (fetchgals_process(variable_get('fetchgals_pid', 0))) {
    $form['process'] = array(
      '#type' => 'item',
      '#description' => t('<h2>A fetchgals process is currently running, please refresh your browser to update any changes in your log.</h2>'),
    );
  }
  else {
    $form['process'] = array(
      '#type' => 'item',
      '#description' => t('<h2>No fetchgals processes currently running.</h2>'),
    );
  }
  $form['fetchgals_log'] = array(
    '#type' => 'fieldset',
    '#title' => t('Log File:'),
  );
  $form['fetchgals_log']['null'] = array(
    '#type' => 'item',
    '#description' => file_get_contents(FG_CWD.'log'),
  );
  return drupal_get_form('fetchgals_log', $form);
} // fetchgals_log

/**
 * Implementation of hook_cron().
 */
function fetchgals_cron() {
  if (!variable_get('fetchgals_cron', 0)) {
    return;
  }
  if (variable_get('fetchgals_clean', 604800)) {
    if ((variable_get('fetchgals_updated_clean', 0) + variable_get('fetchgals_clean', 604800)) <= mktime(variable_get('fetchgals_timecron', 3), 0, 0)) {
      fetchgals_clean_dir('html_dir');
      variable_set('fetchgals_updated_clean', mktime(variable_get('fetchgals_timecron', 3), 0, 0));
    }
  }
  if (variable_get('fetchgals_fetch', 86400)) {
    if ((variable_get('fetchgals_updated_fetch', 0) + variable_get('fetchgals_fetch', 86400)) <= mktime(variable_get('fetchgals_timecron', 3), 0, 0)) {
      fetchgals_update();
      variable_set('fetchgals_updated_fetch', mktime(variable_get('fetchgals_timecron', 3), 0, 0));
    }
  }
  return;
} // fetchgals_cron

/**
 * Runs both -find_galleries and -create_html automatically for the cron (if set)
 */
function fetchgals_update() {
  if (fetchgals_process(variable_get('fetchgals_pid', 0))) {
    watchdog('fetchgals', t('Cannot complete cron as another fetchgals process is currently running.'), WATCHDOG_ERROR);
    return;
  }
  if (!file_exists(fetchgals_check(variable_get('fetchgals_tgp_file', './tgps')))) {
    watchdog('fetchgals', t("Cannot complete cron as '%gal' file is missing or not readable by the server", array('%gal' => variable_get('fetchgals_tgp_file', './tgps'))), WATCHDOG_ERROR);
    return;
  }
  if (!file_exists(fetchgals_check(variable_get('fetchgals_gallery_file', './galleries')))) {
    watchdog('fetchgals', t</