- Posts: 11
COMMUNITY FORUM
- Forum
- Free Joomla Extensions & Templates
- Simple RSS Feed Reader
- change code so users only see's cached page
change code so users only see's cached page
- John37309
-
Topic Author
- Offline
- New Member
Less
More
15 years 11 months ago - 15 years 11 months ago #19556
by John37309
change code so users only see's cached page was created by John37309
I'm wondering how this code can be altered so that the user only see's the cached version of the page?
In effect we would need 2 files for calling this mod instead of one. One php file for the users to view the cached news content so the user never makes the call for new content. And a second file would be the file that actually checks the RSS feeds for new content. The second file that goes and checks the RSS feeds for new content would have to be run automatically from a Cron Job and set to update the feeds every 2 hours for example. In this way, the user would be seeing updated content but the user would never be the one making the call to update.
The reason i would like to do this is because i have extended the simple feed reader so it checks about 50 RSS feeds. Many of the feeds are slow to respond and some of the feeds can hang for long periods of time. The current time-out function is not dealing with this very well. I have it set to time-out after 2 seconds but with 50 feeds, the page loading time for users can be anything up to 30 seconds or 1 minute even. No user will wait that long.
To create this new php page, we just need to alter the code so that one page only reads the cached news and does not update the news.
How can we do this?
Here is the code from the file mod_jw_srfr.php
I'm sure we can do this by making a small change to this part of the code;
John.
In effect we would need 2 files for calling this mod instead of one. One php file for the users to view the cached news content so the user never makes the call for new content. And a second file would be the file that actually checks the RSS feeds for new content. The second file that goes and checks the RSS feeds for new content would have to be run automatically from a Cron Job and set to update the feeds every 2 hours for example. In this way, the user would be seeing updated content but the user would never be the one making the call to update.
The reason i would like to do this is because i have extended the simple feed reader so it checks about 50 RSS feeds. Many of the feeds are slow to respond and some of the feeds can hang for long periods of time. The current time-out function is not dealing with this very well. I have it set to time-out after 2 seconds but with 50 feeds, the page loading time for users can be anything up to 30 seconds or 1 minute even. No user will wait that long.
To create this new php page, we just need to alter the code so that one page only reads the cached news and does not update the news.
How can we do this?
Here is the code from the file mod_jw_srfr.php
<?php
/*
// JoomlaWorks "Simple RSS Feed Reader" Module for Joomla! 1.5.x - Version 1.4
// License: http://www.gnu.org/copyleft/gpl.html
// Copyright (c) 2006 - 2008 JoomlaWorks, a Komrade LLC company.
// More info at https://www.joomlaworks.net
// Developers: Fotis Evangelou
// ***Last update: May 20th, 2008***
*/
/** ensure this file is being included by a parent file */
defined('_JEXEC') or die('Restricted access');
global $mainframe;
// j!1.5 paths
$mosConfig_absolute_path = JPATH_SITE;
$mosConfig_live_site = JURI :: base();
if(substr($mosConfig_live_site, -1)=="/") $mosConfig_live_site = substr($mosConfig_live_site, 0, -1);
// module parameters
$moduleclass_sfx = $params->get( 'moduleclass_sfx','');
$srfr_cache = intval($params->get('srfr_cache',30));
$srfr_timeout = intval($params->get('srfr_timeout',10));
$srfr_fitems = intval($params->get('srfr_fitems',5));
$srfr_totalitems = intval($params->get('srfr_totalitems'));
$srfr_ftimezone = intval($params->get('srfr_ftimezone',0));
$srfr_fname = intval($params->get('srfr_fname',1));
$srfr_fititle = intval($params->get('srfr_fititle',1));
$srfr_fitime = intval($params->get('srfr_fitime',1));
$srfr_fi_content = $params->get('srfr_fi_content','none');
$srfr_fi_words = intval($params->get('srfr_fi_words',''));
$srfr_fi_hideimages = intval($params->get('srfr_fi_hideimages',0));
$striptags = intval($params->get('striptags',0));
$srfr_url01 = $params->get( 'srfr_url01', 'http://feeds.feedburner.com/joomlaworks' );
$srfr_url02 = $params->get( 'srfr_url02', '' );
$srfr_url03 = $params->get( 'srfr_url03', '' );
$srfr_url04 = $params->get( 'srfr_url04', '' );
$srfr_url05 = $params->get( 'srfr_url05', '' );
$srfr_url06 = $params->get( 'srfr_url06', '' );
$srfr_url07 = $params->get( 'srfr_url07', '' );
$srfr_url08 = $params->get( 'srfr_url08', '' );
$srfr_url09 = $params->get( 'srfr_url09', '' );
$srfr_url10 = $params->get( 'srfr_url10', '' );
$srfr_url11 = $params->get( 'srfr_url11', '' );
$srfr_url12 = $params->get( 'srfr_url12', '' );
$srfr_url13 = $params->get( 'srfr_url13', '' );
$srfr_url14 = $params->get( 'srfr_url14', '' );
$srfr_url15 = $params->get( 'srfr_url15', '' );
$srfr_url16 = $params->get( 'srfr_url16', '' );
$srfr_url17 = $params->get( 'srfr_url17', '' );
$srfr_url18 = $params->get( 'srfr_url18', '' );
$srfr_url19 = $params->get( 'srfr_url19', '' );
$srfr_url20 = $params->get( 'srfr_url20', '' );
// SimplePie Setup
if(!class_exists("SimplePie")){
require_once($mosConfig_absolute_path.'/modules/mod_jw_srfr/mod_jw_srfr/simplepie.inc');
}
require_once($mosConfig_absolute_path.'/modules/mod_jw_srfr/mod_jw_srfr/idn/idna_convert.class.php');
// Call the feeds
$myfeeds = array();
$myfeeds[] = ''.$srfr_url01.'';
if ($srfr_url02) {$myfeeds[] = ''.$srfr_url02.'';}
if ($srfr_url03) {$myfeeds[] = ''.$srfr_url03.'';}
if ($srfr_url04) {$myfeeds[] = ''.$srfr_url04.'';}
if ($srfr_url05) {$myfeeds[] = ''.$srfr_url05.'';}
if ($srfr_url06) {$myfeeds[] = ''.$srfr_url06.'';}
if ($srfr_url07) {$myfeeds[] = ''.$srfr_url07.'';}
if ($srfr_url08) {$myfeeds[] = ''.$srfr_url08.'';}
if ($srfr_url09) {$myfeeds[] = ''.$srfr_url09.'';}
if ($srfr_url10) {$myfeeds[] = ''.$srfr_url10.'';}
if ($srfr_url11) {$myfeeds[] = ''.$srfr_url11.'';}
if ($srfr_url12) {$myfeeds[] = ''.$srfr_url12.'';}
if ($srfr_url13) {$myfeeds[] = ''.$srfr_url13.'';}
if ($srfr_url14) {$myfeeds[] = ''.$srfr_url14.'';}
if ($srfr_url15) {$myfeeds[] = ''.$srfr_url15.'';}
if ($srfr_url16) {$myfeeds[] = ''.$srfr_url16.'';}
if ($srfr_url17) {$myfeeds[] = ''.$srfr_url17.'';}
if ($srfr_url18) {$myfeeds[] = ''.$srfr_url18.'';}
if ($srfr_url19) {$myfeeds[] = ''.$srfr_url19.'';}
if ($srfr_url20) {$myfeeds[] = ''.$srfr_url20.'';}
// This array will hold the items we'll be grabbing.
$first_items = array();
// Let's go through the array, feed by feed, and store the items we want.
foreach ($myfeeds as $url) {
// Use the long syntax
$feed = new SimplePie();
$feed->set_feed_url($url);
// Set timeout
$feed->set_timeout($srfr_timeout);
// Check if the cache folder exists
if(file_exists($mosConfig_absolute_path.'/cache')) {
$feed->enable_cache(true);
$feed->set_cache_duration($srfr_cache*60);
$feed->set_cache_location($mosConfig_absolute_path . '/cache');
} else {
$feed->enable_cache(false);
}
$feed->init();
// As long as we're not trying to grab more items than the feed has, go through them one by one and add them to the array.
for ($x = 0; $x < $feed->get_item_quantity($srfr_fitems); $x++) {$first_items[] = $feed->get_item($x);}
// We're done with this feed, so let's release some memory.
unset($feed);
}
// We need to sort the items by date with a user-defined sorting function.
// Since usort() won't accept "SimplePie::sort_items", we need to wrap it in a new function.
if(!function_exists("sort_items")){
function sort_items($a, $b) {return SimplePie::sort_items($a, $b);}
}
// Now we can sort $first_items with our custom sorting function.
usort($first_items, "sort_items");
/* ----------------------- Content Handling ----------------------- */
// Word limitation
if (!function_exists('word_limiter')) {
function word_limiter($str, $limit = 100, $end_char = '…') {
if (trim($str) == '')
return $str;
preg_match('/\s*(?:\S*\s*){'. (int) $limit .'}/', $str, $matches);
if (strlen($matches[0]) == strlen($str))
$end_char = '';
return rtrim($matches[0]).$end_char;
}
}
// OUTPUT
$mod_jwsrfr_head = '
<!-- JW "Simple RSS Feed Reader" Module (v1.4) starts here -->
<style type="text/css" media="screen">
@import "modules/mod_jw_srfr/mod_jw_srfr/mod_jw_srfr.css";
</style>
<!-- JW "Simple RSS Feed Reader" Module (v1.4) ends here -->
';
$mainframe->addCustomHeadTag($mod_jwsrfr_head);
?>
<!-- JoomlaWorks "Simple RSS Feed Reader" Module (v1.4) starts here -->
<?php if ($feed->error){ echo '<span class="message">'.$feed->error().'</span>'; } ?>
<div id="srfr-container<?php echo $moduleclass_sfx; ?>">
<ul class="srfr">
<?php
if($srfr_totalitems) { $i=0; }
foreach($first_items as $key => $item) {
if($srfr_totalitems) {if($i>=$srfr_totalitems) continue;}
$feed = $item->get_feed();
?>
<li class="srfr-row<?php echo ($key%2); ?>">
<!-- feed item title -->
<?php if($srfr_fititle) { ?>
<a class="srfr-feed-title" target="_blank" href="<?php echo $item->get_permalink(); ?>">
<?php echo $item->get_title(); ?>
</a>
<?php } ?>
<!-- feed item timestamp -->
<?php if($srfr_fitime) { ?>
<span class="srfr-feed-timestamp">
<?php
if($srfr_ftimezone) {
echo $item->get_date('G:i (\G\M\T) - j.m.Y'); // GMT timezone
} else {
echo $item->get_date('j M Y | g:i a'); // Local timezone
}
?>
</span>
<?php } ?>
<!-- feed name -->
<?php if($srfr_fname) { ?>
<a class="srfr-feed-name" target="_blank" href="<?php echo $feed->get_permalink(); ?>">
<?php echo $feed->get_title(); ?>
</a>
<?php } ?>
<!-- feed item intro/full text -->
<?php
// Assign
$introtext = $item->get_description();
$fulltext = $item->get_content();
// Remove images
if ($srfr_fi_hideimages) {
$introtext = preg_replace("/<img.+?>/", "", $introtext);
$fulltext = preg_replace("/<img.+?>/", "", $fulltext);
}
// HTML cleanup
$allowed_tags = "<img><p><br><a><b>"; // These tags will NOT be stripped off!
if ($striptags) {
$introtext = strip_tags($introtext, $allowed_tags);
$fulltext = strip_tags($fulltext, $allowed_tags);
}
// Word limitation
if ($srfr_fi_words) {
$introtext = word_limiter($item->get_description(),$srfr_fi_words);
$fulltext = word_limiter($item->get_content(),$srfr_fi_words);
}
?>
<?php if($srfr_fi_content=="intro") { ?>
<p class="srfr-feed-intro"><?php echo $introtext; ?></p>
<?php } ?>
<?php if($srfr_fi_content=="full") { ?>
<p class="srfr-feed-full"><?php echo $fulltext; ?></p>
<?php } ?>
</li>
<?php
if($srfr_totalitems) { $i++; }
}
?>
</ul>
</div>
<!-- JoomlaWorks "Simple RSS Feed Reader" Module (v1.4) ends here -->I'm sure we can do this by making a small change to this part of the code;
// This array will hold the items we'll be grabbing.
$first_items = array();
// Let's go through the array, feed by feed, and store the items we want.
foreach ($myfeeds as $url) {
// Use the long syntax
$feed = new SimplePie();
$feed->set_feed_url($url);
// Set timeout
$feed->set_timeout($srfr_timeout);
// Check if the cache folder exists
if(file_exists($mosConfig_absolute_path.'/cache')) {
$feed->enable_cache(true);
$feed->set_cache_duration($srfr_cache*60);
$feed->set_cache_location($mosConfig_absolute_path . '/cache');
} else {
$feed->enable_cache(false);
}
$feed->init();John.
Please Log in or Create an account to join the conversation.
- John37309
-
- Offline
- New Member
Less
More
- Posts: 11
15 years 11 months ago - 15 years 11 months ago #19557
by John37309
Replied by John37309 on topic Re: change code so users only see's cached page
OK, on the simplepie website, i found a tutorial written out that explains how to run simplepie from a cron job so the user only see's cached content. This will speed up your website by a gizillion times if we can get this working with our Joomla Simple feed reader :D
This is the article; simplepie.org/wiki/tutorial/setting_up_a_cron_job_with_simplepie
In the article, like my idea, he suggests creating another php page called "update_simplepie_cache.php" that we run from a cron job automatically.
So the real question here is how to adapt the code that he suggests to make it work with our Simple Feed Reader inside Joomla. Exactly how much of the code from our file "mod_jw_srfr.php" do we need to include to make this work with Joomla?
This the the code the guy suggests for the new file "update_simplepie_cache.php"
Then we would run this file from a cron job with the linux command;
We would also need to make this file accessable from outside the Joomla framework to allow the cron job to work and get around this peice of code;
We would then change our $srfr_timeout to -1 and $feed->set_cache_duration($srfr_cache*60); to (999999999);
Would anyone like to suggest how much of our SRFR code we need to include in this php file to make this work?
John.
This is the article; simplepie.org/wiki/tutorial/setting_up_a_cron_job_with_simplepie
In the article, like my idea, he suggests creating another php page called "update_simplepie_cache.php" that we run from a cron job automatically.
So the real question here is how to adapt the code that he suggests to make it work with our Simple Feed Reader inside Joomla. Exactly how much of the code from our file "mod_jw_srfr.php" do we need to include to make this work with Joomla?
This the the code the guy suggests for the new file "update_simplepie_cache.php"
<?php
require 'simplepie.inc';
$urls = array([enter all your feed urls here]);
$cache_location = './cache'; // change to your cache location
$feed = new SimplePie();
$feed->set_feed_url($urls);
$feed->set_cache_location($cache_location);
$feed->set_cache_duration(0); // force cache to update immediatlely
$feed->set_timeout(5); // optional, if you have a lot of feeds a low timeout may be necessary
$feed->init();
?>Then we would run this file from a cron job with the linux command;
wget -O /dev/null yoursite.com/update_simplepie_cache.php
We would also need to make this file accessable from outside the Joomla framework to allow the cron job to work and get around this peice of code;
defined('_JEXEC') or die('Restricted access');We would then change our $srfr_timeout to -1 and $feed->set_cache_duration($srfr_cache*60); to (999999999);
Would anyone like to suggest how much of our SRFR code we need to include in this php file to make this work?
John.
Please Log in or Create an account to join the conversation.
- Forum
- Free Joomla Extensions & Templates
- Simple RSS Feed Reader
- change code so users only see's cached page