Tag: search

Goosle 1.7.1 is available now on Github!

Goosle version 1.7.1 adds a new magnet search engine and includes a lot of small improvements. Notable new features include a timeout function for if the response of a search engine is anything but good. Goosle will set a timeout of 15 minutes to 12 hours to give the search source time to unban you or recover from whatever is going wrong on their end.

How long this timeout is depends on the response code, say you’re banned, or the site simply returns no useful response. Or there is a server error, you’re over some kind of quota. That sort of thing.

Search queries have been improved to better filter your overrides and they’re no longer doubly encoded too. And the search recommendation now actually works too. Google, Mojeek and Duckduckgo can provide a search recommendation.

Changes in version 1.7.1 released on August 26, 2024

  • [new] Engine timeouts for specific response codes when a search engine returns some kind of error or quota limitation
  • [new] Engine timeouts status page at /functions/timeout-status.php
  • [new] GloTorrents (Glodls) Magnet results
  • [new] Use multiple search overrides (eg: \’size:large safe:off goose gone wild\’)
  • [fix] Search suggestions re-added and they now work (Scraped from Mojeek, Google, DuckduckGo and Yahoo Images)
  • [fix] Limetorrents search query is now properly formatted
  • [fix] Search overrides (Safe search, image size, etc.) trigger no longer included in search query
  • [fix] Search query no longer sent out double encoded
  • [fix] Strings (Search queries, seo texts, etc.) are now properly limited to max length where required
  • [fix] Multiple currency conversions now also works when caching is enabled
  • [fix] Multiple ip lookups (from different user IPs) now also works when caching is enabled
  • [update] Oauth page no longer center aligned
  • [update] Updated Language explanation in config.default.php
  • [change] Moved footer code to footer.php
  • [change] Redid error.php to only include the error html
  • [change] Openverse adds image category tags to image alt text
  • [change] Pixabay uses image tags as image alt text
  • [change] Image alt text now has a 1.5x multiplier for result ranking (was 1x)
  • [change] Added imdb.com link to Box office popup
  • [change] Added movie poster to Box office popup
  • [change] Simplified verified uploader popup text

Try Goosle for yourself

You can try Goosle for yourself and set up your own search engine in only a few minutes. I’ve made the source code available on Github: https://github.com/adegans/Goosle.

Goosle works on most modern servers that have PHP7.4 or newer and should take less than 10 minutes to install and set up. All you need is basic webhosting, a SSL certificate and a domain name. Check the included readme.md or the Github page for setup details.

Getting help

You can post your questions on Github as a discussion.

Goosle 1.7 is available now on Github!

Goosle version 1.7 adds new search engines and includes a lot of tweaks and little improvements. Mojeek and Pixabay are now available as search engines. Pixabay is especially interesting because they provide high quality photos and have a large database. You’ll need an access token, check out the readme file for setup instructions.

More and better meta information for Magnet results to give you better insights in what you’re downloading. As well as an improved NSFW filter for Magnet search.

Recently pagination got added to results, this allows for more results to be gathered. All limits and result amounts have been tweaked to better reflect this. This is most visible in Image results.

Search object

To centralize the processing of search queries a Search Object was added in a recent update. This has been expanded to also include the safe search override as well as the image search size override. This standardizes the information going around inside Goosle a lot making things more predictable and efficient.

Theme tweaks

Various layout and formatting tweaks are included, a few more pixels to space things out here. A few icons there. Some margins adjusted, etc. Overall these are minor changes but it should be more pleasing on the eyes to use Goosle. If you notice missing icons, or misaligned elements like paragraphs being too close together, clear your browser cache.

Changes in version 1.7 released on August 7, 2024

  • NOTICE: config.default.php has changed, update your config.php!!
  • [new] Mojeek search results
  • [new] Pixabay Image results (Requires free API key, see installation instructions)
  • [new] Keyword multiplier for result ranking
  • [new] Web search can be turned off
  • [new] Cache News results for an hour only, regardless of the cache setting
  • [new] Dynamic SEO description for results page (Should be visible when sharing the page)
  • [new] ‘Verified’ label for magnet results where supported
  • [update] Added x.com for social media detection
  • [update] Added more keywords for nsfw detection in magnet results
  • [change] Raised Qwant Images limit from 50 to 150
  • [change] Raised Hackernews and Qwant News limit from 30 to 50
  • [change] Lowered Wikipedia results from 10 to maximum 5
  • [change] Replaced ‘porn’ with ‘nsfw’ for safe search switch
  • [change] Removed ‘xxx’ as an keyword to disable safe search
  • [change] Don’t search on nyaa.si and YTS if you search with safemode off
  • [change] Moved image size override into search object
  • [change] Added a little space between rows for image results on mobile
  • [change] Stats font is now ‘Courier’
  • [fix] Google search query not providing good results
  • [fix] Search query not always properly urlencoded
  • [removed] Removed search suggestions as they didn’t work

Try Goosle for yourself

You can try Goosle for yourself and set up your own search engine in only a few minutes. I’ve made the source code available on Github. https://github.com/adegans/Goosle

Goosle works on most modern servers that have PHP7.4 or newer and should take less than 10 minutes to install and set up. All you need is basic webhosting and a domain name. Check the included readme.md or the Github page for setup details.

Getting help

You can post your questions on Github as a discussion.

Goosle 1.6.1 is available now on Github!

A quick update for Goosle fixing a number of bugs and including a bunch of useful tweaks. Version 1.6.1 improves some elements introduced in version 1.6.

The DuckDuckGo engine has a more direct scrap instruction. Tooltips introduced in 1.6 now also work reliably on smaller screens. Pagination is more spaced out so it’s easier to tap the pages on phones. And a number of bugs with features that were introduced recently have been resolved.

Changes in version 1.6.1 released on July 19, 2024

  • NOTICE: config.default.php has changed, update your config.php!!
  • [new] Query logger for debugging (See config.default.php for details)
  • [tweak] Scrape query for DuckDuckGo to be more direct
  • [tweak] Added url arguments to the formatted url of search results
  • [tweak] Improved tooltips to be popups with better explanations
  • [tweak] Improved spacing for pagination links
  • [fix] More accurately show the current version in the footer
  • [fix] Current version not properly stored
  • [fix] Pagination offset off by one result
  • [fix] Unnecessary global in load_search()
  • [fix] Typo in wordpress search
  • [fix] Qwant initial total hits and ranking more accurate
  • [fix] Goosle header title not bold on stats page
  • [fix] Visual fixes to the design of Goosle

Try Goosle for yourself

I’ve made the source code available on Github. https://github.com/adegans/Goosle

Goosle should work on most modern servers that have PHP7.4 or newer and should take less than 10 minutes to install and set up. All you need is basic webhosting and a domain name. Check the included readme.md or the Github page for details.

Getting help

You can post your questions on Github as a discussion.

Goosle 1.6 is available now on Github!

Goosle 1.6 is a big update to previous versions including a number of bug fixes and many new and improved features.

If you use caching, results now have pagination. You can configure how many results per page Goosle should show in the config.php. Goosle also tries to detect a more meta data for magnet results, such as movie codecs, audio formats and language. A lot of this data can be assumed from the torrent title and Goosle tries to standardize on the terms to make finding stuff more easy and predictable.

Crawlers

A new crawlers for Wordpress developer pages is added and all crawlers have been updated and tweaked and optimized. Most notably, all engines would individually process your query and interpret what you want from it. This has been moved to be processed earlier in the search routine allowing a new object with predictable and standardized data which is shared with all relevant engines.

This basically means that Goosle no longer has to dissect your query multiple times per search, depending on how many engines you have enabled this could be 1 to 8 times, just to detect if you want safe mode on or off. Or if you wanted a special search or not.

Stats

Goosle 1.6 counts how many searches you do on it. Every query that gets processed is counted. You’ll find the link for it in the lower left corner in the footer. I thought it would be interesting to see how many searches Goosle handles.

Other improvements

On top of the obvious stuff, a lot of code has been updated and improved. Stuff you don’t really see. Double code has been merged into functions to be re-used for example. Magnet trackers have been updated, a few removed, a few new ones.

Special searches have been updated to look more uniform. And the dark theme has had some tweaks to mute the brighter colors a bit. The help page has been updated. The Dictionary search has been improved and much more small tweaks and improvements.

Changes in version 1.6 released on July 15, 2024

  • NOTICE: config.default.php has changed, update your config.php!!
  • [change] Moved magnet popups into combined function
  • [change] Better handling of EZTV TV Show data
  • [change] Better handling of YTS movie data
  • [change] Added 6 new public trackers for Magnets
  • [change] Removed regularly unresponsive trackers for Magnets
  • [change] Search query string processed before search so all engines don’t have to do it individually
  • [change] Updated help page
  • [new] Special searches can have a note/disclaimer in the lower right corner
  • [new] Results pagination for all search tabs (Requires caching to be enabled)
  • [new] WordPress function, hook and filter lookup as a special search (See help page)
  • [new] Language meta data for some Magnet results
  • [new] Try to detect audio codec for EZTV results
  • [new] Show MPA Rating for some movie results
  • [new] Filter to include NSFW Magnet results or not
  • [new] Override NSFW filter with prefix keywords (see config.php)
  • [new] Simple search stat counter (Link in footer)
  • [tweak] Muted the blue and white text in dark theme a tiny bit
  • [tweak] Better light blue header in light theme
  • [tweak] Added title and alt attributes to relevant links/images
  • [tweak] Removed Magnet search limit of 200 results
  • [fix] HTML rendering issues for tags in paragraphs
  • [fix] Start page buttons in light theme now use the right css variables
  • [fix] Properly decode quotes in code snippers for PHP special search
  • [fix] Image, News and Magnet search no longer work if they’re disabled in config.php
  • [fix] 2nd search suggestion not showing if it’s available
  • [fix] Removed non-functional checking if query is empty in every engine
  • [fix] Correctly uses user provided auth hash to keep searching
  • [fix] Correctly ‘expire’ share links for guests so they can not use Goosle beyond seeing the shared results

Try Goosle for yourself

I’ve made the source code available on Github. https://github.com/adegans/Goosle

Goosle should work on most modern servers that have PHP7.4 or newer and should take less than 10 minutes to install and set up. All you need is basic webhosting and a domain name. Check the included readme.md or the Github page for details.

Getting help

You can post your questions on Github as a discussion.

Goosle 1.5 is available now on Github!

Goosle 1.5 is a huge update to previous versions including a number of bug fixes ranging from no longer caching empty results to better handling and formatting results. But also has a ton of new features and new search engines to get results from. Much improved Magnet and Image search and a dedicated News tab and a Box Office page for new torrent releases on some popular sites.

Crawlers

New crawlers include Brave Search, Yahoo News and Sukebei (porn anime). Actual engines got added through their API are Qwant, Qwants Images, Qwant News and Hackernews.

The Openverse token renewal process got improved as well.

Other improvements

Goosle 1.5 now sends more accurate headers to servers in order to get a better response and to try and mask itself as a browser, and not a Meta Search engine. With the current search engines this seems to work very well.

Various CSS elements got tweaked and improved so Goosle looks even better. And as requested, Goosle gained colorschemes. Current colorschemes are light, dark and default. You can choose which one to use in the config.php.

Magnet results got vastly improved with better meta data. A ‘more info’ popup for certain downloads that show movie summaries and download links. Goosle also tries to detect more and relevant meta data from video and audio results. And, to make sharing Magnet Results more easy there is a share function that copies a special url to your clipboard. You can then share that url to have the result highlighted in the Magnet Results.

With all these new features and search options the config file got a lot of new settings. Some have been removed, so make sure your config.php file matches the options offered in config.default.php. You can add them in more-or-less the same order or start a new config.php file from the default one. Check the readme.md file for some pointers on how to deal with this.

Cronjobs got expanded

Cronjobs are scheduled background tasks a website or script can do. Goosle has a simple script to run in the background too. In previous versions this was mostly to clean up the file cache and perhaps generating Openverse tokens. But in version 1.5 the update check has been moved into the script as well. Check the readme for details on how to set up a cron job.

Changes in version 1.5 released on June 19, 2024

  • NOTICE: config.default.php has changed, re-create your config.php!!
  • [fix] No longer caches empty results
  • [fix] No longer make a request if the search query is empty
  • [fix] Movie highlight/box office cache now works
  • [fix] Language selector for Qwant, Wikipedia and Duckduckgo
  • [fix] Season and Episode filter for tv show searches
  • [fix] Safe search filter now actually works
  • [fix] Magnet Search category exclusion filter now actually works
  • [fix] Image size filter works more reliably
  • [fix] Handling of doublequotes in search queries
  • [fix] Search sources now show result amounts accurately
  • [fix] Old cache files are now actually deleted when expired
  • [fix] Search tabs not properly centered on smaller screens
  • [new] Box Office page with latest/new downloads from a few supported torrent websites
  • [new] News page with the latest news from major outlets
  • [new] Popup with movie info and download links for YTS Movie Highlights
  • [new] CSS colorschemes configurable in config.php
  • [new] Easily share magnet links with other Goosle users
  • [new] Search results from Quant API
  • [new] Search results from Brave
  • [new] Image results from Qwant Image API
  • [new] News results from Hackernews
  • [new] News results from Yahoo! News
  • [new] News results from Brave News
  • [new] News results from Qwant News API
  • [new] Magnet results from Sukebei.nyaa.si
  • [new] Special search for IP Lookups via ipify (Search for “ip” or “myip”)
  • [new] Safe search switch for Yahoo! Images
  • [new] Image size switch for Qwant Images
  • [new] Merge missing magnet meta data from duplicate results if it doesn’t already exist in the matched previous result
  • [new] Detect meta data for Magnet Search results such as sound and video quality.
  • [tweak] Cache ttl is now in hours (was minutes)
  • [tweak] Optimizations in CSS, HTML separators and more
  • [tweak] Moved icons into CSS so they can be colored using colorschemes
  • [tweak] Better handling of image results
  • [tweak] Better handling of empty/incomplete results for all engines
  • [tweak] Better handling of empty/missing meta data for all magnet engines
  • [tweak] Better category detection for Limetorrent magnets
  • [tweak] Raised Magnet search limit to 200 (was 50)
  • [tweak] Raised Wikipedia search limit to 20 (was 10)
  • [tweak] Hide magnet results with 0 seeders by default
  • [tweak] Uniform array formatting for all engines
  • [tweak] Consistent use of single-quotes and double-qoutes
  • [tweak] File size string conversion and formatting for all image and magnet engines
  • [tweak] Update checks are now done weekly(ish) via the Cron job
  • [tweak] Updated .htaccess caching rules
  • [removed] CSS for 320px viewport

Try Goosle for yourself

I’ve made the source code available on Github. https://github.com/adegans/Goosle

Goosle should work on most modern servers that have PHP7.4 or newer and should take less than 10 minutes to install and set up. All you need is basic webhosting and a domain name. Check the included readme.md or the Github page for details.

Getting help

You can post your questions on Github as a discussion.