You are here: Foswiki>Tasks Web>Item9603 (16 Jan 2017, MichaelDaum)Edit Attach

Item9603: Creating archivist based on Cache::FastMmap

pencil
Priority: Normal
Current State: Closed
Released In: n/a
Target Release: n/a
Applies To: Extension
Component: DBCacheContrib
Branches:
Reported By: PaulHarvey
Waiting For: Main.PaulHarvey
Last Change By: MichaelDaum
This task is created out of a sudden, urgent need to get some new data online via Foswiki, and I'm running out of memory. Will be using CPAN:Cache::FastMmap

Don't worry, I won't be touching any existing code DBCache code, hopefully just a new archivist to choose from and a new script in tools/ to launch a fastmmap daemon that will look after the mmap cache file(s)

Goals:
  • One single ~1.3GB process with the mmap cache
  • Memory-efficiency for each fastcgi foswiki process (~200MB? Currently ~300MB, and then 1.1GB with the new data)
  • Faster than BDB; closer to Storable performance

... and from this I might have some lessons learnt to help make Foswiki's core search functionality more scalable too.

-- PaulHarvey - 02 Sep 2010

Closing due to inactivity.

-- MichaelDaum - 16 Jan 2017
 
Topic revision: r2 - 16 Jan 2017, MichaelDaum
The copyright of the content on this website is held by the contributing authors, except where stated elsewhere. See Copyright Statement. Creative Commons License    Legal Imprint    Privacy Policy