BackupRestoreTest Class Reference

Unit test for backup and restore of database header pages and a VersionedRandomAllocationSegment. More...

Inheritance diagram for BackupRestoreTest:

List of all members.

Public Types
enum	OpType {   OP_READ_SEQ, OP_WRITE_SEQ, OP_READ_RAND, OP_WRITE_RAND,   OP_READ_NOWAIT, OP_WRITE_NOWAIT, OP_WRITE_SKIP, OP_SCRATCH,   OP_PREFETCH, OP_PREFETCH_BATCH, OP_ALLOCATE, OP_DEALLOCATE,   OP_CHECKPOINT, OP_RESIZE_CACHE, OP_MAX }
	The various operations that can be run in the multi-threaded test. More...
Public Member Functions
	BackupRestoreTest ()
void	testHeaderBackupRestore ()
	Tests backup and restore of the database header pages.
void	testBackupCleanup ()
	Tests that backup properly cleans up after either an error or an abort.
void	testBackupRestoreUncompressed ()
	Tests backup and restore of data pages, without compression.
void	testBackupRestoreCompressed ()
	Tests backup and restore of data pages, with compression.
virtual void	testCaseSetUp ()
	Equivalent to JUnit TestCase.setUp; this is called before each test case method is invoked.
virtual void	openSegmentStorage (DeviceMode openMode)
virtual void	closeStorage ()
virtual void	testAllocateAll ()
	Initializes all disk pages, filling them with information based on their block numbers.
virtual void	verifyPage (CachePage &page, uint x)
	Verifies that the page contents are correct (based on the parameter x).
virtual void	fillPage (CachePage &page, uint x)
	Scribbles on the contents of a page.
virtual void	openStorage (DeviceMode openMode)
virtual CachePage *	lockPage (OpType opType, uint iPage)
virtual void	unlockPage (CachePage &page, LockMode lockMode)
virtual void	prefetchPage (uint iPage)
virtual void	prefetchBatch (uint, uint)
virtual void	testAllocate ()
virtual void	testDeallocate ()
virtual void	testCheckpoint ()
	Performs a periodic checkpoint.
void	testSingleThread ()
virtual void	openRandomSegment ()
SharedSegment	createLinearDeviceSegment (DeviceId deviceId, uint nPages)
void	closeLinearSegment ()
void	closeRandomSegment ()
void	closeVersionedRandomSegment ()
void	closeSnapshotRandomSegment ()
Cache &	getCache ()
virtual SharedCache	newCache ()
SharedRandomAccessDevice	openDevice (std::string devName, DeviceMode openMode, uint nDevicePages, DeviceId deviceId)
virtual void	testCaseTearDown ()
	Equivalent to JUnit TestCase.tearDown; this is called after each test case method is invoked.
void	closeDevice (DeviceId deviceId, SharedRandomAccessDevice &pDevice)
TestSuite *	releaseTestSuite ()
void	beforeTestCase (std::string testCaseName)
void	afterTestCase (std::string testCaseName)
virtual void	notifyTrace (std::string source, TraceLevel level, std::string message)
	Receives notification when a trace event occurs.
virtual TraceLevel	getSourceTraceLevel (std::string source)
	Gets the level at which a particular source should be traced.
bool	testOp (OpType opType, uint iPage, bool bNice)
	Carries out one operation on a page.
char const *	getOpName (OpType opType)
	Makes up an operation name based on an OpType.
LockMode	getLockMode (OpType opType)
	Gets the LockMode corresponding to an OpType.
void	testSequentialOp (OpType opType)
	Carries out an operation on each disk page in order from 0 to nDiskPages-1.
void	testRandomOp (OpType opType)
	Carries out an operation on nRandomOps pages selected at random.
void	testSkipOp (OpType opType, uint n)
	Carries out an operation on every "n" pages, starting at page 0.
void	testScratch ()
	Performs nRandomOps scratch operations.
void	testPrefetch ()
	Performs a limited number of prefetch operations.
void	testPrefetchBatch ()
	Performs a limited number of batch prefetch operations.
void	testSequentialRead ()
	Carries out one sequential read pass over the entire device.
void	testSequentialWrite ()
	Carries out one sequential write pass over the entire device.
void	testRandomRead ()
	Carries out nRandomOps read operations on pages selected at random.
void	testRandomWrite ()
	Carries out nRandomOps write operations on pages selected at random.
void	testSkipWrite (uint n)
	Carries out write operations every n pages.
void	testCheckpointGuarded ()
void	testCacheResize ()
void	testMultipleThreads ()
	Carries out specified tests in multi-threaded mode.
virtual void	threadInit ()
virtual void	threadTerminate ()
virtual bool	testThreadedOp (int iOp)
	Test implementation must be supplied by derived test class.
Static Public Member Functions
static void	readParams (int argc, char **argv)
	Parses the command line.
Static Public Attributes
static ParamName	paramTestSuiteName
static ParamName	paramTraceFileName
static ParamName	paramDictionaryFileName
static ParamName	paramTraceLevel
static ParamName	paramStatsFileName
static ParamName	paramTraceStdout
static ParamName	paramDegreeOfParallelism
static ConfigMap	configMap
	Configuration parameters.
Protected Types
enum	VictimPolicy { victimTwoQ, victimLRU, victimRandom }
	The available victim policy implementations. More...
Protected Member Functions
void	setForceCacheUnmap (SharedSegment pSegment)
	Forces the underlying snapshot segment to always execute its checkpoints during a cache flush and unmap.
void	commitChanges (TxnId commitCsn)
	Commits transactions associated with a specified csn.
void	snooze (uint nSeconds)
uint	generateRandomNumber (uint iMax)
void	runThreadedTestCase ()
	Executes specified test threads.
Protected Attributes
uint	nDiskPagesTotal
PageId	firstPageId
DeviceId	tempDeviceId
SharedRandomAccessDevice	pTempDevice
SharedSegment	pTempSegment
TxnId	currCsn
std::vector< TxnId >	updatedCsns
bool	commit
SharedSegment	pSnapshotRandomSegment2
std::vector< PageId >	freeablePages
	Queue of allocated pages waiting to be freed.
StrictMutex	freeablePagesMutex
	Mutex protecting freeablePages.
PageOwnerId	objId
	PageOwnerId to use when allocating pages.
SharedSegmentFactory	pSegmentFactory
SharedSegment	pLinearSegment
	Segment supporting linear page allocation.
SharedSegment	pRandomSegment
	(Optional) segment supporting random page allocation.
SharedSegment	pVersionedRandomSegment
	(Optional) segment supporting versioned random page allocation.
SharedSegment	pSnapshotRandomSegment
	(Optional) segment supporting snapshot random page allocation.
VictimPolicy	victimPolicy
	VictimPolicy to instantiate.
CacheParams	cacheParams
	Parameters for cache initialization.
SharedCache	pCache
	Cache instance being tested.
SharedRandomAccessDevice	pRandomAccessDevice
	The default cached device.
uint	nMemPages
	Size of cache in memory pages.
uint	nDiskPages
	Size of device in disk pages.
uint	cbPageFull
	Disk page size.
DeviceId	dataDeviceId
	Fixed ID to assign to data device.
TestSuite *	pTestSuite
	Boost test suite.
boost::shared_ptr< TestBase >	pTestObj
std::ofstream	traceStream
	Output file stream for tracing.
StrictMutex	traceMutex
	Protects traceStream.
std::string	testName
	Name of test.
TraceLevel	traceLevel
	Level at which to trace test execution.
FileStatsTarget	statsTarget
	Output for stats.
StatsTimer	statsTimer
	Timer for stats collection.
bool	traceStdout
	Copy trace output to stdout.
bool	traceFile
	Copy trace output to file.
TestCaseGroup	defaultTests
TestCaseGroup	extraTests
uint	cbPageUsable
	Portion of each page that should be scribbled on.
uint	nRandomOps
	Number of random access operations to run per pass.
uint	nSecondsBetweenCheckpoints
	Checkpoint interval during multi-threaded test.
StrictMutex	logMutex
	Protects output stream.
SXMutex	checkpointMutex
	SXMutex used to synchronize checkpoints with write actions.
bool	bTestResize
	Flag indicating that the cache should be dynamically resized during the multi-threaded portion of the test.
uint	nSeconds
	Duration of multi-threaded test.
std::vector< int >	threadCounts
	Number of threads to run for each type of operation.
Static Protected Attributes
static bool	runAll
	Run all test cases, including the extra tests.
static std::string	runSingle
	Run only the test case of this name.
Private Types
typedef SegNodeLock< TestNode >	TestPageLock
Private Member Functions
void	createSnapshotData ()
void	executeSnapshotTxn (int i)
void	verifySnapshotData (uint x)
void	testBackupRestore (bool isCompressed)
void	backup (std::string backupFileName, TxnId lowerBoundCsn, TxnId upperBoundCsn, bool isCompressed)
void	restore (std::string backupFileName, TxnId lowerBoundCsn, TxnId upperBoundCsn, bool isCompressed)
std::string	getCompressionProgram (bool isCompressed)
void	verifyData ()
Private Attributes
SharedDatabase	pDatabase
PageId	persistentPageId
Classes
struct	TestNode

---

Detailed Description

Unit test for backup and restore of database header pages and a VersionedRandomAllocationSegment.

Definition at line 43 of file BackupRestoreTest.cpp.

---

Member Typedef Documentation

typedef SegNodeLock<TestNode> BackupRestoreTest::TestPageLock [private]

Definition at line 52 of file BackupRestoreTest.cpp.

---

Member Enumeration Documentation

enum CacheTestBase::VictimPolicy [protected, inherited]

The available victim policy implementations.

Enumerator:

victimTwoQ
victimLRU
victimRandom

Definition at line 44 of file CacheTestBase.h.

                      {
        victimTwoQ,
        victimLRU,
        victimRandom
    };

enum PagingTestBase::OpType [inherited]

The various operations that can be run in the multi-threaded test.

Enumerator:

OP_READ_SEQ
OP_WRITE_SEQ
OP_READ_RAND
OP_WRITE_RAND
OP_READ_NOWAIT
OP_WRITE_NOWAIT
OP_WRITE_SKIP
OP_SCRATCH
OP_PREFETCH
OP_PREFETCH_BATCH
OP_ALLOCATE
OP_DEALLOCATE
OP_CHECKPOINT
OP_RESIZE_CACHE
OP_MAX

Definition at line 83 of file PagingTestBase.h.

                {
        OP_READ_SEQ,
        OP_WRITE_SEQ,
        OP_READ_RAND,
        OP_WRITE_RAND,
        OP_READ_NOWAIT,
        OP_WRITE_NOWAIT,
        OP_WRITE_SKIP,
        OP_SCRATCH,
        OP_PREFETCH,
        OP_PREFETCH_BATCH,
        OP_ALLOCATE,
        OP_DEALLOCATE,
        OP_CHECKPOINT,
        OP_RESIZE_CACHE,
        OP_MAX
    };

---

Constructor & Destructor Documentation

BackupRestoreTest::BackupRestoreTest

(

)

[inline, explicit]

Definition at line 76 of file BackupRestoreTest.cpp.

References testBackupCleanup(), testBackupRestoreCompressed(), testBackupRestoreUncompressed(), and testHeaderBackupRestore().

    {
        FENNEL_UNIT_TEST_CASE(BackupRestoreTest, testHeaderBackupRestore);
        FENNEL_UNIT_TEST_CASE(BackupRestoreTest, testBackupCleanup);
        FENNEL_UNIT_TEST_CASE(BackupRestoreTest, testBackupRestoreUncompressed);
        FENNEL_UNIT_TEST_CASE(BackupRestoreTest, testBackupRestoreCompressed);
    }

---

Member Function Documentation

void BackupRestoreTest::createSnapshotData

(

)

[private]

Definition at line 115 of file BackupRestoreTest.cpp.

References SegNodeLock< Node >::allocatePage(), Segment::checkpoint(), CHECKPOINT_FLUSH_ALL, SnapshotRandomAllocationSegment::commitChanges(), TestBase::configMap, DeviceMode::createNew, executeSnapshotTxn(), SegNodeLock< Node >::getNodeForWrite(), Database::newDatabase(), CacheTestBase::pCache, pDatabase, persistentPageId, and SegPageLock::unlock().

Referenced by testBackupCleanup(), and testHeaderBackupRestore().

{
    // Create a database with a single data page with an initial value of 0.
    pDatabase = Database::newDatabase(
        pCache,
        configMap,
        DeviceMode::createNew,
        shared_from_this());

    SharedLogicalTxn pTxn = pDatabase->getTxnLog()->newLogicalTxn(pCache);
    SharedSegment pSegment =
        pDatabase->getSegmentFactory()->newSnapshotRandomAllocationSegment(
            pDatabase->getDataSegment(),
            pDatabase->getDataSegment(),
            pTxn->getTxnId());
    SnapshotRandomAllocationSegment *pSnapshotSegment =
        SegmentFactory::dynamicCast<SnapshotRandomAllocationSegment *>(
            pSegment);
    SegmentAccessor segmentAccessor(pSegment,pCache);

    TestPageLock pageLock(segmentAccessor);
    persistentPageId = pageLock.allocatePage();
    pageLock.getNodeForWrite().x = 0;
    pageLock.unlock();
    pTxn->commit();
    pTxn = pDatabase->getTxnLog()->newLogicalTxn(pCache);
    pSnapshotSegment->commitChanges(pTxn->getTxnId());
    pSnapshotSegment->checkpoint(CHECKPOINT_FLUSH_ALL);
    pTxn->commit();
    pDatabase->checkpointImpl();

    // Update the value to 5.
    executeSnapshotTxn(5);
}

void BackupRestoreTest::executeSnapshotTxn

(

int

i

)

[private]

Definition at line 376 of file BackupRestoreTest.cpp.

References Segment::checkpoint(), CHECKPOINT_FLUSH_ALL, SnapshotRandomAllocationSegment::commitChanges(), SegNodeLock< Node >::getNodeForWrite(), SegPageLock::lockExclusive(), CacheTestBase::pCache, pDatabase, persistentPageId, and SegPageLock::unlock().

Referenced by createSnapshotData(), testBackupCleanup(), and testHeaderBackupRestore().

{
    SharedLogicalTxn pTxn = pDatabase->getTxnLog()->newLogicalTxn(pCache);
    SharedSegment pSegment =
        pDatabase->getSegmentFactory()->newSnapshotRandomAllocationSegment(
            pDatabase->getDataSegment(),
            pDatabase->getDataSegment(),
            pTxn->getTxnId());
    SnapshotRandomAllocationSegment *pSnapshotSegment =
        SegmentFactory::dynamicCast<SnapshotRandomAllocationSegment *>(
            pSegment);

    // Update the value, which will version the page.
    SegmentAccessor segmentAccessor(pSegment, pCache);
    TestPageLock pageLock(segmentAccessor);
    pageLock.lockExclusive(persistentPageId);
    pageLock.getNodeForWrite().x += i;
    pageLock.unlock();
    pTxn->commit();

    // Commit the changes through the snapshot segment.
    pTxn = pDatabase->getTxnLog()->newLogicalTxn(pCache);
    pSnapshotSegment->commitChanges(pTxn->getTxnId());
    pSnapshotSegment->checkpoint(CHECKPOINT_FLUSH_ALL);
    pTxn->commit();
    pDatabase->checkpointImpl();
}

void BackupRestoreTest::verifySnapshotData

(

uint

x

)

[private]

Definition at line 404 of file BackupRestoreTest.cpp.

References SegNodeLock< Node >::getNodeForRead(), SegPageLock::lockShared(), CacheTestBase::pCache, pDatabase, and persistentPageId.

Referenced by testBackupCleanup(), and testHeaderBackupRestore().

{
    // Lock the original page, but because we're accessing the segment
    // through a snapshot segment with the csn set to that of the last
    // committed transaction, we'll pick up the latest version of the page.
    SharedSegment pSegment =
        pDatabase->getSegmentFactory()->newSnapshotRandomAllocationSegment(
            pDatabase->getDataSegment(),
            pDatabase->getDataSegment(),
            pDatabase->getLastCommittedTxnId());
    SegmentAccessor segmentAccessor(pSegment,pCache);
    TestPageLock pageLock(segmentAccessor);
    pageLock.lockShared(persistentPageId);
    BOOST_CHECK_EQUAL(pageLock.getNodeForRead().x,x);
}

void BackupRestoreTest::testBackupRestore

(

bool

isCompressed

)

[private]

Definition at line 420 of file BackupRestoreTest.cpp.

References backup(), SnapshotSegmentTestBase::closeStorage(), DeviceMode::createNew, SnapshotSegmentTestBase::currCsn, DeviceMode::load, NULL_TXN_ID, SegmentTestBase::openStorage(), restore(), SnapshotSegmentTestBase::testAllocateAll(), PagingTestBase::testSkipWrite(), SnapshotSegmentTestBase::updatedCsns, and verifyData().

Referenced by testBackupRestoreCompressed(), and testBackupRestoreUncompressed().

{
    // Create and initialize a VersionedRandomAllocationSegment using
    // a snapshot with TxnId(0)
    currCsn = TxnId(0);
    openStorage(DeviceMode::createNew);
    testAllocateAll();
    closeStorage();

    // Update every 5 pages
    currCsn = TxnId(5);
    updatedCsns.push_back(currCsn);
    openStorage(DeviceMode::load);
    testSkipWrite(5);
    closeStorage();

    // Do a backup of all pages as of TxnId 5
    std::string backup5 = "backupTxnId5.dat";
    backup(backup5, NULL_TXN_ID, TxnId(5), isCompressed);

    // Update every 7 pages
    currCsn = TxnId(7);
    updatedCsns.push_back(currCsn);
    openStorage(DeviceMode::load);
    testSkipWrite(7);
    closeStorage();

    // Do another backup of all pages between TxnId's 5 and 7
    std::string backup5to7 = "backupTxnId5to7.dat";
    backup(backup5to7, TxnId(5), TxnId(7), isCompressed);

    // Update every 11 pages
    currCsn = TxnId(11);
    updatedCsns.push_back(currCsn);
    openStorage(DeviceMode::load);
    testSkipWrite(11);
    closeStorage();

    // Do a backup of all pages between TxnId's 7 and 11
    std::string backup7to11 = "backupTxnId7to11.dat";
    backup(backup7to11, TxnId(7), TxnId(11), isCompressed);

    // Do a backup of all pages between TxnId's 5 and 11
    std::string backup5to11 = "backupTxnId5to11.dat";
    backup(backup5to11, TxnId(5), TxnId(11), isCompressed);

    // Restore the backup as of TxnId 5
    restore(backup5, NULL_TXN_ID, TxnId(5), isCompressed);

    // Make sure the data only reflects up to TxnId 5.  Leave the currCsn
    // set to the larger value, but have updatedCsn's reflect only the
    // updates up to TxnId 5.
    updatedCsns.clear();
    updatedCsns.push_back(TxnId(5));
    verifyData();

    // Restore the backup as of TxnId 7 and verify that it only includes
    // updates up to TxnId 7
    restore(backup5to7, TxnId(5), TxnId(7), isCompressed);
    updatedCsns.push_back(TxnId(7));
    verifyData();

    // Restore the backup as of TxnId 11 and verify that it includes all
    // updates
    restore(backup7to11, TxnId(7), TxnId(11), isCompressed);
    updatedCsns.push_back(TxnId(11));
    verifyData();

    // Go back and do restores of the backup at TxnId5 followed by the
    // backup of TxnId's 5 through 11.
    restore(backup5, NULL_TXN_ID, TxnId(5), isCompressed);
    updatedCsns.clear();
    updatedCsns.push_back(TxnId(5));
    verifyData();
    restore(backup5to11, TxnId(5), TxnId(11), isCompressed);
    updatedCsns.push_back(TxnId(7));
    updatedCsns.push_back(TxnId(11));
    verifyData();
}

void BackupRestoreTest::backup	(	std::string	backupFileName,
		TxnId	lowerBoundCsn,
		TxnId	upperBoundCsn,
		bool	isCompressed
	)			[private]

Definition at line 500 of file BackupRestoreTest.cpp.

References VersionedRandomAllocationSegment::backupAllocationNodes(), VersionedRandomAllocationSegment::backupDataPages(), SnapshotSegmentTestBase::closeStorage(), getCompressionProgram(), DeviceMode::load, SegPageBackupRestoreDevice::newSegPageBackupRestoreDevice(), SegmentTestBase::openStorage(), CacheTestBase::pCache, CacheTestBase::pRandomAccessDevice, SegStorageTestBase::pSegmentFactory, and SegStorageTestBase::pVersionedRandomSegment.

Referenced by testBackupRestore().

{
    openStorage(DeviceMode::load);
    VersionedRandomAllocationSegment *pVRSegment =
        SegmentFactory::dynamicCast<VersionedRandomAllocationSegment *>(
            pVersionedRandomSegment);
    SegmentAccessor scratchAccessor =
        pSegmentFactory->newScratchSegment(pCache, 12);

    if (isCompressed) {
        backupFileName.append(".gz");
    }
    SharedSegPageBackupRestoreDevice pBackupDevice =
        SegPageBackupRestoreDevice::newSegPageBackupRestoreDevice(
            backupFileName,
            "w",
            getCompressionProgram(isCompressed),
            10,
            2,
            scratchAccessor,
            pCache->getDeviceAccessScheduler(*pRandomAccessDevice),
            pRandomAccessDevice);
    bool abortFlag = false;
    pVRSegment->backupAllocationNodes(
        pBackupDevice,
        false,
        lowerBoundCsn,
        upperBoundCsn,
        abortFlag);
    pVRSegment->backupDataPages(
        pBackupDevice,
        lowerBoundCsn,
        upperBoundCsn,
        abortFlag);

    assert(pBackupDevice.unique());
    pBackupDevice.reset();

    scratchAccessor.reset();
    closeStorage();
}

void BackupRestoreTest::restore	(	std::string	backupFileName,
		TxnId	lowerBoundCsn,
		TxnId	upperBoundCsn,
		bool	isCompressed
	)			[private]

Definition at line 546 of file BackupRestoreTest.cpp.

References CHECKPOINT_FLUSH_AND_UNMAP, SnapshotSegmentTestBase::closeStorage(), getCompressionProgram(), DeviceMode::load, SegPageBackupRestoreDevice::newSegPageBackupRestoreDevice(), SegmentTestBase::openStorage(), CacheTestBase::pCache, CacheTestBase::pRandomAccessDevice, SegStorageTestBase::pSegmentFactory, SegStorageTestBase::pVersionedRandomSegment, and VersionedRandomAllocationSegment::restoreFromBackup().

Referenced by testBackupRestore().

{
    openStorage(DeviceMode::load);
    VersionedRandomAllocationSegment *pVRSegment =
        SegmentFactory::dynamicCast<VersionedRandomAllocationSegment *>(
            pVersionedRandomSegment);
    SegmentAccessor scratchAccessor =
        pSegmentFactory->newScratchSegment(pCache, 10);

    // Flush and unmap any pages currently in the cache so the restore
    // avoids reading out-of-date pages
    MappedPageListenerPredicate pagePredicate(*pVRSegment);
    pCache->checkpointPages(pagePredicate, CHECKPOINT_FLUSH_AND_UNMAP);

    if (isCompressed) {
        backupFileName.append(".gz");
    }
    SharedSegPageBackupRestoreDevice pBackupDevice =
        SegPageBackupRestoreDevice::newSegPageBackupRestoreDevice(
            backupFileName,
            "r",
            getCompressionProgram(isCompressed),
            10,
            0,
            scratchAccessor,
            pCache->getDeviceAccessScheduler(*pRandomAccessDevice),
            pRandomAccessDevice);
    bool abortFlag = false;
    pVRSegment->restoreFromBackup(
        pBackupDevice,
        lowerBoundCsn,
        upperBoundCsn,
        abortFlag);

    assert(pBackupDevice.unique());
    pBackupDevice.reset();

    scratchAccessor.reset();
    closeStorage();
}

std::string BackupRestoreTest::getCompressionProgram

(

bool

isCompressed

)

[private]

Definition at line 591 of file BackupRestoreTest.cpp.

Referenced by backup(), restore(), and testBackupCleanup().

{
    if (!isCompressed) {
        return "";
    } else {
        return "gzip";
    }
}

void BackupRestoreTest::verifyData

(

)

[private]

Definition at line 600 of file BackupRestoreTest.cpp.

References SnapshotSegmentTestBase::closeStorage(), DeviceMode::load, SegmentTestBase::openStorage(), and PagingTestBase::testSequentialRead().

Referenced by testBackupRestore().

{
    openStorage(DeviceMode::load);
    testSequentialRead();
    closeStorage();
}

void BackupRestoreTest::testHeaderBackupRestore

(

)

Tests backup and restore of the database header pages.

Definition at line 150 of file BackupRestoreTest.cpp.

References CacheTestBase::cacheParams, TestBase::configMap, createSnapshotData(), executeSnapshotTxn(), Cache::newCache(), NULL_TXN_ID, Database::paramDatabaseDir, CacheTestBase::pCache, pDatabase, CacheParams::readConfig(), ConfigMap::setStringParam(), and verifySnapshotData().

Referenced by BackupRestoreTest().

{
    configMap.setStringParam(
        Database::paramDatabaseDir,".");
    configMap.setStringParam(
        "databaseInitSize","1000");
    configMap.setStringParam(
        "tempInitSize","1000");
    configMap.setStringParam(
        "databaseShadowLogInitSize","1000");
    configMap.setStringParam(
        "databaseTxnLogInitSize","1000");
    configMap.setStringParam(
        "forceTxns","true");
    configMap.setStringParam(
        "disableSnapshots","false");

    CacheParams cacheParams;
    cacheParams.readConfig(configMap);
    pCache = Cache::newCache(cacheParams);

    // Create a single data page in the database with an initial value,
    // and then update the value to 5.  Doing the update will version
    // the data page.
    createSnapshotData();
    pDatabase->checkpointImpl();
    verifySnapshotData(5);

    // Backup the data with value 5.
    std::string fullBackup = "fullBackup.dat";
    FileSize dataDeviceSize;
    bool aborted = false;
    TxnId fullTxnId =
        pDatabase->initiateBackup(
            fullBackup,
            false,
            0,
            NULL_TXN_ID,
            "",
            dataDeviceSize,
            aborted);
    pDatabase->completeBackup(NULL_TXN_ID, fullTxnId, aborted);

    // Update the value to 15.
    executeSnapshotTxn(10);
    verifySnapshotData(15);

    // Do an incremental backup of value 15.
    std::string incrBackup1 = "incrBackup1.dat";
    TxnId incrTxnId1 =
        pDatabase->initiateBackup(
            incrBackup1,
            true,
            0,
            fullTxnId,
            "",
            dataDeviceSize,
            aborted);

    // Make sure ALTER SYSTEM DEALLOCATE OLD is disabled
    uint nPagesBefore =
        pDatabase->getDataSegment()->getAllocatedSizeInPages();
    pDatabase->deallocateOldPages(incrTxnId1);
    uint nPagesAfter =
        pDatabase->getDataSegment()->getAllocatedSizeInPages();
    BOOST_REQUIRE(nPagesBefore == nPagesAfter);

    pDatabase->completeBackup(fullTxnId, incrTxnId1, aborted);

    // Make sure ALTER SYSTEM DEALLOCATE OLD is reenabled
    pDatabase->deallocateOldPages(incrTxnId1);
    nPagesAfter = pDatabase->getDataSegment()->getAllocatedSizeInPages();
    BOOST_REQUIRE(nPagesBefore > nPagesAfter);

    // Update the value to 35.
    executeSnapshotTxn(20);
    verifySnapshotData(35);

    // Do a second incremental backup with value 35.
    std::string incrBackup2 = "incrBackup2.dat";
    TxnId incrTxnId2 =
        pDatabase->initiateBackup(
            incrBackup2,
            true,
            4096,
            incrTxnId1,
            "",
            dataDeviceSize,
            aborted);
    pDatabase->completeBackup(incrTxnId1, incrTxnId2, aborted);

    // Restore the full backup.  The value should be 5.
    pDatabase->restoreFromBackup(
        fullBackup,
        1002 * pCache->getPageSize(),
        "",
        NULL_TXN_ID,
        fullTxnId,
        aborted);
    verifySnapshotData(5);

    // Restore the first incremental backup.  The value should be 15.
    pDatabase->restoreFromBackup(
        incrBackup1,
        1002 * pCache->getPageSize(),
        "",
        fullTxnId,
        incrTxnId1,
        aborted);
    verifySnapshotData(15);

    // Restore the second incremental backup.  The value should be 35.
    pDatabase->restoreFromBackup(
        incrBackup2,
        1002 * pCache->getPageSize(),
        "",
        incrTxnId1,
        incrTxnId2,
        aborted);
    verifySnapshotData(35);

    pDatabase.reset();
}

void BackupRestoreTest::testBackupCleanup

(

)

Tests that backup properly cleans up after either an error or an abort.

Definition at line 274 of file BackupRestoreTest.cpp.

References CacheTestBase::cacheParams, TestBase::configMap, createSnapshotData(), executeSnapshotTxn(), getCompressionProgram(), FileSystem::getDiskFreeSpace(), FennelExcn::getMessage(), Cache::newCache(), NULL_TXN_ID, Database::paramDatabaseDir, CacheTestBase::pCache, pDatabase, CacheParams::readConfig(), FileSystem::remove(), ConfigMap::setStringParam(), and verifySnapshotData().

Referenced by BackupRestoreTest().

{
    configMap.setStringParam(
        Database::paramDatabaseDir,".");
    configMap.setStringParam(
        "databaseInitSize","1000");
    configMap.setStringParam(
        "tempInitSize","1000");
    configMap.setStringParam(
        "databaseShadowLogInitSize","1000");
    configMap.setStringParam(
        "databaseTxnLogInitSize","1000");
    configMap.setStringParam(
        "forceTxns","true");
    configMap.setStringParam(
        "disableSnapshots","false");

    CacheParams cacheParams;
    cacheParams.readConfig(configMap);
    pCache = Cache::newCache(cacheParams);

    // Create a single data page in the database with an initial value,
    // and then update the value to 5.  Doing the update will version
    // the data page.
    createSnapshotData();
    pDatabase->checkpointImpl();
    verifySnapshotData(5);

    // Update the value to 15.
    executeSnapshotTxn(10);
    verifySnapshotData(15);

    std::string fullBackup = "fullBackup.dat";

    // Set the space padding to the amount of space currently available
    // multipled by 1000.  This should result in a failure unless some other
    // user is using this filesystem and either:
    // A) that user is freeing up a large amount of space, or
    // B) that user is freeing up space and the filesystem is short on space,
    //    in which case, multiplying by 1000 doesn't yield a large enough value
    //    to offset the amount that the user has freed
    FileSystem::remove(fullBackup.c_str());
    FileSize spaceAvailable;
    FileSystem::getDiskFreeSpace(".", spaceAvailable);
    FileSize dataDeviceSize;
    bool aborted = false;
    try {
        pDatabase->initiateBackup(
            fullBackup,
            true,
            spaceAvailable * 1000,
            NULL_TXN_ID,
            "",
            dataDeviceSize,
            aborted);
        BOOST_FAIL("Out of space exception not returned");
    } catch (FennelExcn &ex) {
        std::string errMsg = ex.getMessage();
        if (errMsg.find("Insufficient space") != 0) {
            BOOST_FAIL("Wrong exception returned");
        }
    }

    // Make sure ALTER SYSTEM DEALLOCATE OLD is enabled, even after the
    // exception
    uint nPagesBefore =
        pDatabase->getDataSegment()->getAllocatedSizeInPages();
    pDatabase->deallocateOldPages(pDatabase->getLastCommittedTxnId());
    uint nPagesAfter =
        pDatabase->getDataSegment()->getAllocatedSizeInPages();
    BOOST_REQUIRE(nPagesBefore > nPagesAfter);

    // Do another update so a new page is allocated
    executeSnapshotTxn(20);
    verifySnapshotData(35);

    // Initiate a new backup and then abort it.
    pDatabase->initiateBackup(
        fullBackup,
        false,
        0,
        NULL_TXN_ID,
        getCompressionProgram(true),
        dataDeviceSize,
        aborted);
    pDatabase->abortBackup();

    // Make sure ALTER SYSTEM DEALLOCATE OLD is enabled, even after the
    // backup was aborted
    nPagesBefore =
        pDatabase->getDataSegment()->getAllocatedSizeInPages();
    pDatabase->deallocateOldPages(pDatabase->getLastCommittedTxnId());
    nPagesAfter =
        pDatabase->getDataSegment()->getAllocatedSizeInPages();
    BOOST_REQUIRE(nPagesBefore > nPagesAfter);

    // Abort a backup that was never initiated; should be a no-op
    pDatabase->abortBackup();

    pDatabase.reset();
}

void BackupRestoreTest::testBackupRestoreUncompressed

(

)

Tests backup and restore of data pages, without compression.

Definition at line 105 of file BackupRestoreTest.cpp.

References testBackupRestore().

Referenced by BackupRestoreTest().

{
    testBackupRestore(false);
}

void BackupRestoreTest::testBackupRestoreCompressed

(

)

Tests backup and restore of data pages, with compression.

Definition at line 110 of file BackupRestoreTest.cpp.

References testBackupRestore().

Referenced by BackupRestoreTest().

{
    testBackupRestore(true);
}

void SnapshotSegmentTestBase::setForceCacheUnmap

(

SharedSegment

pSegment

)

[protected, inherited]

Forces the underlying snapshot segment to always execute its checkpoints during a cache flush and unmap.

Definition at line 87 of file SnapshotSegmentTestBase.cpp.

References SnapshotRandomAllocationSegment::setForceCacheUnmap().

Referenced by SnapshotSegmentTestBase::openSegmentStorage(), LcsClusterReplaceExecStreamTest::testClusterReplace(), and SnapshotSegmentTest::testUncommittedReads().

{
    // Force the snapshot segment to always execute its checkpoints during
    // a cache flush and unmap, in order to unmap these page from the cache
    if (pSegment) {
        SnapshotRandomAllocationSegment *pSnapshotSegment =
            SegmentFactory::dynamicCast<SnapshotRandomAllocationSegment *>(
                pSegment);
        pSnapshotSegment->setForceCacheUnmap();
    }
}

void SnapshotSegmentTestBase::commitChanges

(

TxnId

commitCsn

)

[protected, inherited]

Commits transactions associated with a specified csn.

Parameters:

commitCsn

the specified csn

Definition at line 161 of file SnapshotSegmentTestBase.cpp.

References SnapshotSegmentTestBase::commit, SnapshotRandomAllocationSegment::commitChanges(), SegStorageTestBase::pSnapshotRandomSegment, and SnapshotRandomAllocationSegment::rollbackChanges().

Referenced by SnapshotSegmentTestBase::closeStorage().

{
    if (pSnapshotRandomSegment) {
        SnapshotRandomAllocationSegment *pSnapshotSegment =
            SegmentFactory::dynamicCast<SnapshotRandomAllocationSegment *>(
                pSnapshotRandomSegment);
        if (commit) {
            pSnapshotSegment->commitChanges(commitCsn);
        } else {
            pSnapshotSegment->rollbackChanges();
        }
    }
}

void SnapshotSegmentTestBase::testCaseSetUp

(

)

[virtual, inherited]

Equivalent to JUnit TestCase.setUp; this is called before each test case method is invoked.

Default is no-op.

Reimplemented from TestBase.

Reimplemented in LcsClusterReplaceExecStreamTest.

Definition at line 40 of file SnapshotSegmentTestBase.cpp.

References SnapshotSegmentTestBase::commit, SnapshotSegmentTestBase::currCsn, and SnapshotSegmentTestBase::updatedCsns.

Referenced by LcsClusterReplaceExecStreamTest::testCaseSetUp().

{
    currCsn = TxnId(0);
    commit = true;
    updatedCsns.clear();
}

void SnapshotSegmentTestBase::openSegmentStorage

(

DeviceMode

openMode

)

[virtual, inherited]

Reimplemented from SegStorageTestBase.

Definition at line 47 of file SnapshotSegmentTestBase.cpp.

References DeviceMode::create, SegStorageTestBase::createLinearDeviceSegment(), SnapshotSegmentTestBase::currCsn, CacheTestBase::dataDeviceId, SnapshotSegmentTestBase::firstPageId, CacheTestBase::nDiskPages, SnapshotSegmentTestBase::nDiskPagesTotal, NULL_PAGE_ID, CacheTestBase::openDevice(), SegStorageTestBase::pLinearSegment, SegStorageTestBase::pRandomSegment, SegStorageTestBase::pSegmentFactory, SegStorageTestBase::pSnapshotRandomSegment, SnapshotSegmentTestBase::pTempDevice, SnapshotSegmentTestBase::pTempSegment, SegStorageTestBase::pVersionedRandomSegment, SnapshotSegmentTestBase::setForceCacheUnmap(), and SnapshotSegmentTestBase::tempDeviceId.

{
    nDiskPages = nDiskPagesTotal;
    if (openMode.create) {
        firstPageId = NULL_PAGE_ID;
    }

    pTempDevice =
        openDevice("temp.dat", openMode, nDiskPages / 50, tempDeviceId);
    SharedSegment pTempDeviceSegment =
        createLinearDeviceSegment(tempDeviceId, nDiskPages / 50);
    pTempSegment =
        pSegmentFactory->newRandomAllocationSegment(
            pTempDeviceSegment,
            openMode.create);

    SharedSegment pDeviceSegment =
        createLinearDeviceSegment(dataDeviceId, nDiskPages);
    pVersionedRandomSegment =
        pSegmentFactory->newVersionedRandomAllocationSegment(
            pDeviceSegment,
            pTempSegment,
            openMode.create);
    pSnapshotRandomSegment =
        pSegmentFactory->newSnapshotRandomAllocationSegment(
            pVersionedRandomSegment,
            pVersionedRandomSegment,
            currCsn);
    setForceCacheUnmap(pSnapshotRandomSegment);

    pRandomSegment = pSnapshotRandomSegment;

    nDiskPages /= 2;
    SharedSegment pLinearViewSegment =
        pSegmentFactory->newLinearViewSegment(
            pSnapshotRandomSegment,
            firstPageId);
    pLinearSegment = pLinearViewSegment;
}

void SnapshotSegmentTestBase::closeStorage

(

)

[virtual, inherited]

Reimplemented from SegStorageTestBase.

Definition at line 99 of file SnapshotSegmentTestBase.cpp.

References CacheTestBase::closeDevice(), SegStorageTestBase::closeLinearSegment(), SegStorageTestBase::closeSnapshotRandomSegment(), SegStorageTestBase::closeStorage(), SegStorageTestBase::closeVersionedRandomSegment(), SnapshotSegmentTestBase::commitChanges(), SnapshotSegmentTestBase::currCsn, VersionedRandomAllocationSegment::freeTempPages(), SegStorageTestBase::pRandomSegment, SnapshotSegmentTestBase::pSnapshotRandomSegment2, SnapshotSegmentTestBase::pTempDevice, SnapshotSegmentTestBase::pTempSegment, SegStorageTestBase::pVersionedRandomSegment, and SnapshotSegmentTestBase::tempDeviceId.

Referenced by backup(), SnapshotSegmentTest::deallocateOldPages(), restore(), testBackupRestore(), SnapshotSegmentTest::testDeallocateOld(), SnapshotSegmentTest::testRollback(), SnapshotSegmentTest::testSnapshotReads(), SnapshotSegmentTest::testUncommittedReads(), and verifyData().

{
    commitChanges(currCsn);
    closeLinearSegment();
    pRandomSegment.reset();
    closeSnapshotRandomSegment();
    if (pSnapshotRandomSegment2) {
        assert(pSnapshotRandomSegment2.unique());
        pSnapshotRandomSegment2.reset();
    }
    // Free leftover temp pages used during page versioning
    if (pVersionedRandomSegment) {
        VersionedRandomAllocationSegment *pVRSegment =
            SegmentFactory::dynamicCast<VersionedRandomAllocationSegment *>(
                pVersionedRandomSegment);
        pVRSegment->freeTempPages();
    }
    closeVersionedRandomSegment();
    if (pTempSegment) {
        // Confirm that all temp pages have been freed.
        BOOST_REQUIRE(pTempSegment->getAllocatedSizeInPages() == 0);
        assert(pTempSegment.unique());
        pTempSegment.reset();
    }
    if (pTempDevice) {
        closeDevice(tempDeviceId, pTempDevice);
    }
    SegmentTestBase::closeStorage();
}

void SnapshotSegmentTestBase::testAllocateAll

(

)

[virtual, inherited]

Initializes all disk pages, filling them with information based on their block numbers.

Reimplemented from PagingTestBase.

Definition at line 129 of file SnapshotSegmentTestBase.cpp.

References SnapshotSegmentTestBase::firstPageId, LinearViewSegment::getFirstPageId(), NULL_PAGE_ID, SegStorageTestBase::pLinearSegment, and PagingTestBase::testAllocateAll().

Referenced by testBackupRestore(), SnapshotSegmentTest::testDeallocateOld(), SnapshotSegmentTest::testRollback(), SnapshotSegmentTest::testSnapshotReads(), and SnapshotSegmentTest::testUncommittedReads().

{
    SegmentTestBase::testAllocateAll();
    assert(firstPageId == NULL_PAGE_ID);
    LinearViewSegment *pLinearViewSegment =
        SegmentFactory::dynamicCast<LinearViewSegment *>(pLinearSegment);
    assert(pLinearViewSegment);
    firstPageId = pLinearViewSegment->getFirstPageId();
}

void SnapshotSegmentTestBase::verifyPage	(	CachePage &	page,
		uint	x
	)			[virtual, inherited]

Verifies that the page contents are correct (based on the parameter x).

Reimplemented from PagingTestBase.

Definition at line 139 of file SnapshotSegmentTestBase.cpp.

References SnapshotSegmentTestBase::currCsn, opaqueToInt(), SnapshotSegmentTestBase::updatedCsns, and PagingTestBase::verifyPage().

{
    // If the pageId is a multiple of one of the csn's smaller than the
    // current csn, then the page should reflect the update made by
    // that smaller csn
    uint update = 0;
    for (int i = updatedCsns.size() - 1; i >= 0; i--) {
        if (updatedCsns[i] <= currCsn &&
            x % opaqueToInt(updatedCsns[i]) == 0)
        {
            update = opaqueToInt(updatedCsns[i]);
            break;
        }
    }
    SegmentTestBase::verifyPage(page, x + update);
}

void SnapshotSegmentTestBase::fillPage	(	CachePage &	page,
		uint	x
	)			[virtual, inherited]

Scribbles on the contents of a page.

The data written is derived from the parameter x.

Reimplemented from PagingTestBase.

Definition at line 156 of file SnapshotSegmentTestBase.cpp.

References SnapshotSegmentTestBase::currCsn, PagingTestBase::fillPage(), and opaqueToInt().

{
    SegmentTestBase::fillPage(page, x + opaqueToInt(currCsn));
}

void SegmentTestBase::openStorage

(

DeviceMode

openMode

)

[virtual, inherited]

Reimplemented from SegStorageTestBase.

Definition at line 37 of file SegmentTestBase.cpp.

References PagingTestBase::cbPageUsable, PagingTestBase::OP_ALLOCATE, PagingTestBase::OP_DEALLOCATE, SegStorageTestBase::openStorage(), SegStorageTestBase::pLinearSegment, SegStorageTestBase::pRandomSegment, and ThreadedTestBase::threadCounts.

Referenced by backup(), SnapshotSegmentTest::deallocateOldPages(), restore(), RandomAllocationSegmentTest::testAllocateAndDeallocate(), testBackupRestore(), SnapshotSegmentTest::testDeallocateOld(), VersionedSegmentTest::testRecovery(), SnapshotSegmentTest::testRollback(), SegmentTestBase::testSingleThread(), SnapshotSegmentTest::testSnapshotReads(), SnapshotSegmentTest::testUncommittedReads(), and verifyData().

{
    SegStorageTestBase::openStorage(openMode);
    cbPageUsable = pLinearSegment->getUsablePageSize();
    if (!pRandomSegment) {
        threadCounts[OP_ALLOCATE] = 0;
        threadCounts[OP_DEALLOCATE] = 0;
    }
}

CachePage * SegmentTestBase::lockPage	(	OpType	opType,
		uint	iPage
	)			[virtual, inherited]

Implements PagingTestBase.

Definition at line 47 of file SegmentTestBase.cpp.

References SegPageLock::allocatePage(), SegPageLock::dontUnlock(), PagingTestBase::fillPage(), Segment::getLinearBlockNum(), Segment::getLinearPageId(), PagingTestBase::getLockMode(), SegPageLock::getPage(), SegPageLock::isLocked(), SegPageLock::lockPage(), SegmentTestBase::objId, PagingTestBase::OP_ALLOCATE, PagingTestBase::OP_WRITE_RAND, PagingTestBase::OP_WRITE_SEQ, PagingTestBase::OP_WRITE_SKIP, CacheTestBase::pCache, and SegStorageTestBase::pLinearSegment.

{
    SegmentAccessor segmentAccessor(pLinearSegment,pCache);
    SegPageLock pageLock(segmentAccessor);
    if (opType == OP_ALLOCATE) {
        PageId pageId = pageLock.allocatePage(objId);
        assert(Segment::getLinearBlockNum(pageId) == iPage);
        CachePage &page = pageLock.getPage();
        fillPage(page,iPage);
        pageLock.dontUnlock();
        return &page;
    } else {
        PageId pageId = Segment::getLinearPageId(iPage);
        // Prepare the page for update before locking it
        if (opType == OP_WRITE_SEQ || opType == OP_WRITE_RAND ||
            opType == OP_WRITE_SKIP)
        {
            pLinearSegment->updatePage(pageId, true);
        }
        pageLock.lockPage(pageId,getLockMode(opType));
        CachePage *pPage = pageLock.isLocked() ? &(pageLock.getPage()) : NULL;
        pageLock.dontUnlock();
        return pPage;
    }
}

void SegmentTestBase::unlockPage	(	CachePage &	page,
		LockMode	lockMode
	)			[virtual, inherited]

Implements PagingTestBase.

Definition at line 73 of file SegmentTestBase.cpp.

References CacheTestBase::getCache(), and CacheAccessor::unlockPage().

{
    getCache().unlockPage(page,lockMode);
}

void SegmentTestBase::prefetchPage

(

uint

iPage

)

[virtual, inherited]

Implements PagingTestBase.

Definition at line 78 of file SegmentTestBase.cpp.

References CacheTestBase::getCache(), Segment::getLinearPageId(), SegStorageTestBase::pLinearSegment, and CacheAccessor::prefetchPage().

{
    PageId pageId = Segment::getLinearPageId(iPage);
    BlockId blockId = pLinearSegment->translatePageId(pageId);
    getCache().prefetchPage(blockId,pLinearSegment.get());
}

void SegmentTestBase::prefetchBatch	(	uint	,
		uint
	)			[virtual, inherited]

Implements PagingTestBase.

Definition at line 85 of file SegmentTestBase.cpp.

{
    permAssert(false);
}

void SegmentTestBase::testAllocate

(

)

[virtual, inherited]

Reimplemented from PagingTestBase.

Definition at line 90 of file SegmentTestBase.cpp.

References SegmentTestBase::freeablePages, SegmentTestBase::freeablePagesMutex, PagingTestBase::logMutex, PagingTestBase::nRandomOps, NULL_PAGE_ID, SegmentTestBase::objId, CacheTestBase::pCache, SegStorageTestBase::pRandomSegment, SegPageLock::tryAllocatePage(), and SegPageLock::unlock().

{
    assert(pRandomSegment);

    uint i;
    SegmentAccessor segmentAccessor(pRandomSegment,pCache);
    for (i = 0; i < nRandomOps; ++i) {
#ifdef HAVE_SCHED_H
        sched_yield();
#else
        // TODO:  call Mingw equivalent
#endif
        SegPageLock pageLock(segmentAccessor);
        PageId pageId = pageLock.tryAllocatePage(objId);
        if (pageId == NULL_PAGE_ID) {
            break;
        }
        pageLock.unlock();
        StrictMutexGuard freeablePagesGuard(freeablePagesMutex);
        freeablePages.push_back(pageId);
    }
    if (i) {
        StrictMutexGuard logGuard(logMutex);
        BOOST_MESSAGE("completed " << i << " allocate ops");
    }
}

void SegmentTestBase::testDeallocate

(

)

[virtual, inherited]

Reimplemented from PagingTestBase.

Definition at line 117 of file SegmentTestBase.cpp.

References SegPageLock::deallocateLockedPage(), SegmentTestBase::freeablePages, SegmentTestBase::freeablePagesMutex, PagingTestBase::generateRandomNumber(), SegPageLock::lockShared(), PagingTestBase::logMutex, PagingTestBase::nRandomOps, CacheTestBase::pCache, and SegStorageTestBase::pRandomSegment.

{
    assert(pRandomSegment);

    uint i;
    SegmentAccessor segmentAccessor(pRandomSegment,pCache);
    for (i = 0; i < nRandomOps; ++i) {
#ifdef HAVE_SCHED_H
        sched_yield();
#else
        // TODO:  call Mingw equivalent
#endif
        StrictMutexGuard freeablePagesGuard(freeablePagesMutex);
        if (freeablePages.empty()) {
            break;
        }
        uint i = generateRandomNumber(freeablePages.size());
        PageId pageId = freeablePages[i];
        freeablePages.erase(freeablePages.begin() + i);
        freeablePagesGuard.unlock();
        SegPageLock pageLock(segmentAccessor);
        pageLock.lockShared(pageId);
        pageLock.deallocateLockedPage();
    }
    if (i) {
        StrictMutexGuard logGuard(logMutex);
        BOOST_MESSAGE("completed " << i << " deallocate ops");
    }
}

void SegmentTestBase::testCheckpoint

(

)

[virtual, inherited]

Performs a periodic checkpoint.

Reimplemented from PagingTestBase.

Reimplemented in VersionedSegmentTest.

Definition at line 147 of file SegmentTestBase.cpp.

References CHECKPOINT_FLUSH_ALL, and SegStorageTestBase::pLinearSegment.

{
    pLinearSegment->checkpoint(CHECKPOINT_FLUSH_ALL);
}

void SegmentTestBase::testSingleThread

(

)

[inherited]

Definition at line 161 of file SegmentTestBase.cpp.

References SegStorageTestBase::closeStorage(), DeviceMode::createNew, SegmentTestBase::freeablePages, DeviceMode::load, SegmentTestBase::openStorage(), PagingTestBase::testAllocateAll(), PagingTestBase::testRandomRead(), PagingTestBase::testRandomWrite(), PagingTestBase::testSequentialRead(), and PagingTestBase::testSequentialWrite().

Referenced by LinearDeviceSegmentTest::LinearDeviceSegmentTest(), LinearViewSegmentTest::LinearViewSegmentTest(), SnapshotSegmentTest::SnapshotSegmentTest(), and VersionedSegmentTest::VersionedSegmentTest().

{
    openStorage(DeviceMode::createNew);
    testAllocateAll();
    testSequentialRead();
    testSequentialWrite();
    testRandomRead();
    closeStorage();
    openStorage(DeviceMode::load);
    testRandomRead();
    testRandomWrite();
    testSequentialRead();
    closeStorage();
    freeablePages.clear();
}

void SegStorageTestBase::openRandomSegment

(

)

[virtual, inherited]

Reimplemented in LcsClusterReplaceExecStreamTest.

Definition at line 45 of file SegStorageTestBase.cpp.

References SegStorageTestBase::closeStorage(), DeviceMode::load, SegStorageTestBase::openStorage(), SegStorageTestBase::pLinearSegment, SegStorageTestBase::pRandomSegment, and SegStorageTestBase::pSegmentFactory.

Referenced by RandomAllocationSegmentTest::testAllocateAndDeallocate(), LhxHashTableTest::testCaseSetUp(), ExecStreamUnitTestBase::testCaseSetUp(), BTreeTest::testCaseSetUp(), and BTreeReadersTest::testCaseSetUp().

{
    // reopen will interpret pages as already allocated, which
    // is what RandomAllocationSegment expects
    closeStorage();
    openStorage(DeviceMode::load);
    pRandomSegment = pSegmentFactory->newRandomAllocationSegment(
        pLinearSegment, true);
    pLinearSegment.reset();
}

SharedSegment SegStorageTestBase::createLinearDeviceSegment	(	DeviceId	deviceId,
		uint	nPages
	)			[inherited]

Definition at line 56 of file SegStorageTestBase.cpp.

References LinearDeviceSegmentParams::firstBlockId, LinearDeviceSegmentParams::nPagesAllocated, LinearDeviceSegmentParams::nPagesMin, CacheTestBase::pCache, SegStorageTestBase::pSegmentFactory, CompoundId::setBlockNum(), and CompoundId::setDeviceId().

Referenced by VersionedSegmentTest::openSegmentStorage(), SnapshotSegmentTestBase::openSegmentStorage(), SegStorageTestBase::openSegmentStorage(), and LinearViewSegmentTest::openSegmentStorage().

{
    BlockId blockId(0);
    CompoundId::setDeviceId(blockId,deviceId);
    CompoundId::setBlockNum(blockId,0);
    LinearDeviceSegmentParams deviceParams;
    deviceParams.firstBlockId = blockId;
    deviceParams.nPagesMin = nPages;
    deviceParams.nPagesAllocated = nPages;
    return pSegmentFactory->newLinearDeviceSegment(
        pCache,deviceParams);
}

void SegStorageTestBase::closeLinearSegment

(

)

[inherited]

Definition at line 70 of file SegStorageTestBase.cpp.

References SegStorageTestBase::pLinearSegment.

Referenced by VersionedSegmentTest::closeStorage(), SnapshotSegmentTestBase::closeStorage(), SegStorageTestBase::closeStorage(), and SnapshotSegmentTest::testUncommittedReads().

{
    if (pLinearSegment) {
        assert(pLinearSegment.unique());
        pLinearSegment.reset();
    }
}

void SegStorageTestBase::closeRandomSegment

(

)

[inherited]

Definition at line 78 of file SegStorageTestBase.cpp.

References SegStorageTestBase::pRandomSegment.

Referenced by VersionedSegmentTest::closeStorage(), and SegStorageTestBase::closeStorage().

{
    if (pRandomSegment) {
        assert(pRandomSegment.unique());
        pRandomSegment.reset();
    }
}

void SegStorageTestBase::closeVersionedRandomSegment

(

)

[inherited]

Definition at line 86 of file SegStorageTestBase.cpp.

References SegStorageTestBase::pVersionedRandomSegment.

Referenced by SnapshotSegmentTestBase::closeStorage(), and SegStorageTestBase::closeStorage().

{
    if (pVersionedRandomSegment) {
        assert(pVersionedRandomSegment.unique());
        pVersionedRandomSegment.reset();
    }
}

void SegStorageTestBase::closeSnapshotRandomSegment

(

)

[inherited]

Definition at line 94 of file SegStorageTestBase.cpp.

References SegStorageTestBase::pSnapshotRandomSegment.

Referenced by SnapshotSegmentTestBase::closeStorage().

{
    if (pSnapshotRandomSegment) {
        assert(pSnapshotRandomSegment.unique());
        pSnapshotRandomSegment.reset();
    }
}

Cache & CacheTestBase::getCache

(

)

[inherited]

Definition at line 42 of file CacheTestBase.cpp.

References CacheTestBase::pCache.

Referenced by CacheTest::lockPage(), CacheTest::prefetchBatch(), SegmentTestBase::prefetchPage(), CacheTest::prefetchPage(), PagingTestBase::testCacheResize(), PagingTestBase::testCheckpoint(), PagingTestBase::testOp(), PagingTestBase::testScratch(), SegmentTestBase::unlockPage(), and CacheTest::unlockPage().

{
    return *pCache;
}

SharedCache CacheTestBase::newCache

(

)

[virtual, inherited]

Definition at line 66 of file CacheTestBase.cpp.

References CacheTestBase::cacheParams, Cache::newCache(), CacheTestBase::victimLRU, CacheTestBase::victimPolicy, CacheTestBase::victimRandom, and CacheTestBase::victimTwoQ.

Referenced by CacheTestBase::openStorage().

{
    switch (victimPolicy) {
    case victimRandom:
        return SharedCache(
            new RandomCache(cacheParams),
            ClosableObjectDestructor());
    case victimLRU:
        return SharedCache(
            new LRUCache(cacheParams),
            ClosableObjectDestructor());
    case victimTwoQ:
        return Cache::newCache(cacheParams);
    default:
        permAssert(false);
    }
}

SharedRandomAccessDevice CacheTestBase::openDevice	(	std::string	devName,
		DeviceMode	openMode,
		uint	nDevicePages,
		DeviceId	deviceId
	)			[inherited]

Definition at line 84 of file CacheTestBase.cpp.

References CacheTestBase::cbPageFull, DeviceMode::create, CacheTestBase::pCache, and FileSystem::remove().

Referenced by VersionedSegmentTest::openSegmentStorage(), SnapshotSegmentTestBase::openSegmentStorage(), and CacheTestBase::openStorage().

{
    if (openMode.create) {
        FileSystem::remove(devName.c_str());
    }
    SharedRandomAccessDevice pDevice(
        new RandomAccessFileDevice(devName,openMode));
    if (openMode.create) {
        pDevice->setSizeInBytes(nDevicePages*cbPageFull);
    }
    pCache->registerDevice(deviceId,pDevice);
    return pDevice;
}

void CacheTestBase::testCaseTearDown

(

)

[virtual, inherited]

Equivalent to JUnit TestCase.tearDown; this is called after each test case method is invoked.

Default is no-op.

Reimplemented from TestBase.

Reimplemented in LbmEntryTest, LbmLoadBitmapTest, LbmSearchTest, LcsClusterAppendExecStreamTest, LcsClusterReplaceExecStreamTest, LcsMultiClusterAppendTest, LcsRowScanExecStreamTest, BTreeReadersTest, BTreeTest, ExecStreamTestBase, and LhxHashTableTest.

Definition at line 125 of file CacheTestBase.cpp.

References CacheTestBase::closeStorage().

Referenced by LhxHashTableTest::testCaseTearDown(), ExecStreamTestBase::testCaseTearDown(), BTreeTest::testCaseTearDown(), BTreeReadersTest::testCaseTearDown(), and LbmEntryTest::testCaseTearDown().

{
    closeStorage();
}

void CacheTestBase::closeDevice	(	DeviceId	deviceId,
		SharedRandomAccessDevice &	pDevice
	)			[inherited]

Definition at line 130 of file CacheTestBase.cpp.

References CHECKPOINT_FLUSH_AND_UNMAP, and CacheTestBase::pCache.

Referenced by VersionedSegmentTest::closeStorage(), SnapshotSegmentTestBase::closeStorage(), and CacheTestBase::closeStorage().

{
    if (!pDevice) {
        return;
    }
    DeviceIdPagePredicate pagePredicate(deviceId);
    pCache->checkpointPages(pagePredicate,CHECKPOINT_FLUSH_AND_UNMAP);
    pCache->unregisterDevice(deviceId);
    assert(pDevice.unique());
    pDevice.reset();
}

void TestBase::snooze

(

uint

nSeconds

)

[protected, inherited]

Definition at line 263 of file TestBase.cpp.

Referenced by DatabaseTest::executeForceTxn(), ThreadedTestBase::runThreadedTestCase(), PagingTestBase::testCacheResize(), BTreeTxnTest::testCheckpoint(), PagingTestBase::testCheckpointGuarded(), PagingTestBase::testPrefetch(), and PagingTestBase::testPrefetchBatch().

{
#ifdef __MSVC__
    ::_sleep(nSeconds*1000);
#else
    ::sleep(nSeconds);
#endif
}

void TestBase::readParams	(	int	argc,
		char **	argv
	)			[static, inherited]

Parses the command line.

format: [-v] [-t TEST | -all] {param=val}* [CONFIGFILE | -] Normally, the test program runs the default test cases. With the option "-all", runs the extra test cases as well. With the option "-t TEST", runs only the single test case named TEST. CONFIGFILE is read to load configuration parameters. Configuration parameters can also be set ad hoc, from the command line, as pairs name=val. These take precedence.

Definition at line 108 of file TestBase.cpp.

References TestBase::configMap, ConfigMap::dumpParams(), ConfigMap::isParamSet(), ConfigMap::mergeFrom(), TestBase::paramDictionaryFileName, ConfigMap::readParams(), TestBase::runAll, TestBase::runSingle, ConfigMap::setStringParam(), and verbose.

{
    bool verbose = false;
    ConfigMap adhocMap;

    for (int i = 1; i < argc; ++i) {
        std::string arg = argv[i];
        if (argv[i][0] == '-') {
            if (arg == "-v") {
                verbose = true;
            } else if (arg == "-") {
                configMap.readParams(std::cin);
            } else if (arg == "-all") {
                runAll = true;
            } else if (arg == "-t") {   // -t TEST
                permAssert(i + 1 < argc);
                runSingle = argv[++i];
            } else if (arg[1] == 't') { // allow -tTEST
                runSingle = arg.substr(2);
            }
        } else {
            int i = arg.find("=");
            if ((0 < i) && (i < arg.size())) {
                // an ad hoc parameter
                std::string key = arg.substr(0,i);
                std::string val = arg.substr(i + 1);
                adhocMap.setStringParam(key,val);
            } else {
                // a config file name
                std::ifstream configFile(arg.c_str());
                assert(configFile.good());
                configMap.readParams(configFile);
            }
        }
    }
    configMap.mergeFrom(adhocMap);

    // set a default dictionary file location for use by tests that need a
    // small non-random sorted data set
    if (!configMap.isParamSet(paramDictionaryFileName)) {
        std::string dictFileName = "dictWords";
        configMap.setStringParam(paramDictionaryFileName,dictFileName);
    }

    if (verbose) {
        configMap.dumpParams(std::cout);
    }
}

TestSuite * TestBase::releaseTestSuite

(

)

[inherited]

Definition at line 157 of file TestBase.cpp.

References TestBase::TestCaseGroup::addAllToTestSuite(), TestBase::defaultTests, TestBase::extraTests, TestBase::TestCaseGroup::findTest(), TestBase::pTestObj, TestBase::pTestSuite, TestBase::runAll, TestBase::runSingle, and TestBase::testName.

{
    assert(pTestObj);
    assert(pTestObj.use_count() > 1);

    // release self-reference now that all test cases have been registered
    pTestObj.reset();

    TestSuite* pTestSuite = BOOST_TEST_SUITE(testName.c_str());

    if (runSingle.size()) {
        test_unit *p =  defaultTests.findTest(runSingle);
        if (!p) {
            p = extraTests.findTest(runSingle);
        }
        if (!p) {
            std::cerr << "test " << runSingle << " not found\n";
            exit(2);
        }
        pTestSuite->add(p);
    } else {
        defaultTests.addAllToTestSuite(pTestSuite);
        if (runAll) {
            extraTests.addAllToTestSuite(pTestSuite);
        }
    }
    return pTestSuite;
}

void TestBase::beforeTestCase

(

std::string

testCaseName

)

[inherited]

Definition at line 214 of file TestBase.cpp.

References TestBase::configMap, TraceSource::initTraceSource(), AutoBacktrace::install(), TestBase::notifyTrace(), AutoBacktrace::setOutputStream(), AutoBacktrace::setTraceTarget(), TestBase::testName, and TRACE_INFO.

{
    notifyTrace(testName,TRACE_INFO,"ENTER:  " + testCaseName);

    // Install the AutoBacktrace signal handler now, after
    // boost::execution_monitor::catch_signals() has installed its own, so that
    // on SIGABRT AutoBacktrace goes first, prints the backtrace, then chains
    // to boost, which handles the error.
    AutoBacktrace::setOutputStream();
    AutoBacktrace::setTraceTarget(shared_from_this());
    AutoBacktrace::install();
    configMap.initTraceSource(shared_from_this(), "testConfig");
}

void TestBase::afterTestCase

(

std::string

testCaseName

)

[inherited]

Definition at line 228 of file TestBase.cpp.

References TestBase::configMap, TraceSource::disableTracing(), TestBase::notifyTrace(), AutoBacktrace::setTraceTarget(), TestBase::testName, and TRACE_INFO.

{
    AutoBacktrace::setTraceTarget();
    configMap.disableTracing();
    notifyTrace(testName,TRACE_INFO,"LEAVE:  " + testCaseName);
}

void TestBase::notifyTrace	(	std::string	source,
		TraceLevel	level,
		std::string	message
	)			[virtual, inherited]

Receives notification when a trace event occurs.

Parameters:

	source	the facility from which the message originated
	level	the trace event severity level
	message	the text of the message

Implements TraceTarget.

Definition at line 243 of file TestBase.cpp.

References TestBase::traceFile, TestBase::traceMutex, TestBase::traceStdout, and TestBase::traceStream.

Referenced by TestBase::afterTestCase(), and TestBase::beforeTestCase().

{
    if (traceFile || traceStdout) {
        StrictMutexGuard traceMutexGuard(traceMutex);
        if (traceFile) {
            traceStream << "[" << source << "] " << message << std::endl;
            traceStream.flush();
        }
        if (traceStdout) {
            std::cout << "[" << source << "] " << message << std::endl;
            std::cout.flush();
        }
    }
}

TraceLevel TestBase::getSourceTraceLevel

(

std::string

source

)

[virtual, inherited]

Gets the level at which a particular source should be traced.

Parameters:

source

name of source to be traced

Returns:

minimum severity level which should be traced

Implements TraceTarget.

Definition at line 258 of file TestBase.cpp.

References TestBase::traceLevel.

Referenced by LbmExecStreamTestBase::generateBitmaps().

{
    return traceLevel;
}

uint PagingTestBase::generateRandomNumber

(

uint

iMax

)

[protected, inherited]

Definition at line 53 of file PagingTestBase.cpp.

References g_pRNG.

Referenced by PagingTestBase::fillPage(), SegmentTestBase::testDeallocate(), PagingTestBase::testPrefetch(), PagingTestBase::testPrefetchBatch(), PagingTestBase::testRandomOp(), and PagingTestBase::testScratch().

{
    return (*g_pRNG)(iMax);
}

bool PagingTestBase::testOp	(	OpType	opType,
		uint	iPage,
		bool	bNice
	)			[inherited]

Carries out one operation on a page.

This involves locking the page, calling verifyPage or fillPage, and then unlocking the page.

Parameters:

	opType	operation which will be attempted
	iPage	block number of page
	bNice	true if page should be marked as nice as part of access

Returns:

true if the operation was successfully carried out; false if NoWait locking was requested and the page lock could not be acquired

Definition at line 85 of file PagingTestBase.cpp.

References PagingTestBase::fillPage(), CacheTestBase::getCache(), PagingTestBase::getLockMode(), LOCKMODE_S, LOCKMODE_S_NOWAIT, LOCKMODE_X, LOCKMODE_X_NOWAIT, PagingTestBase::lockPage(), CacheAccessor::nicePage(), PagingTestBase::unlockPage(), and PagingTestBase::verifyPage().

Referenced by PagingTestBase::testRandomOp(), PagingTestBase::testSequentialOp(), and PagingTestBase::testSkipOp().

{
    CachePage *pPage = lockPage(opType,iPage);
    LockMode lockMode = getLockMode(opType);
    if (!pPage) {
        // must be NoWait locking failed
        assert(lockMode >= LOCKMODE_S_NOWAIT);
        return false;
    }
    CachePage &page = *pPage;
    if (lockMode == LOCKMODE_S
        || lockMode == LOCKMODE_S_NOWAIT)
    {
        verifyPage(page,iPage);
    } else {
        fillPage(page,iPage);
    }
    switch (lockMode) {
    case LOCKMODE_X_NOWAIT:
        lockMode = LOCKMODE_X;
        break;
    case LOCKMODE_S_NOWAIT:
        lockMode = LOCKMODE_S;
        break;
    default:
        break;
    }
    if (bNice) {
        getCache().nicePage(page);
    }
    unlockPage(page,lockMode);
    return true;
}

char const * PagingTestBase::getOpName

(

OpType

opType

)

[inherited]

Makes up an operation name based on an OpType.

Definition at line 119 of file PagingTestBase.cpp.

References PagingTestBase::OP_ALLOCATE, PagingTestBase::OP_READ_NOWAIT, PagingTestBase::OP_READ_RAND, PagingTestBase::OP_READ_SEQ, PagingTestBase::OP_WRITE_NOWAIT, PagingTestBase::OP_WRITE_RAND, PagingTestBase::OP_WRITE_SEQ, and PagingTestBase::OP_WRITE_SKIP.

Referenced by PagingTestBase::testRandomOp(), PagingTestBase::testSequentialOp(), and PagingTestBase::testSkipOp().

{
    switch (opType) {
    case OP_ALLOCATE:
        return "allocate";
    case OP_READ_SEQ:
        return "sequential read";
    case OP_WRITE_SEQ:
        return "sequential write";
    case OP_READ_RAND:
        return "random read";
    case OP_WRITE_RAND:
        return "random write";
    case OP_READ_NOWAIT:
        return "read no-wait";
    case OP_WRITE_NOWAIT:
        return "write no-wait";
    case OP_WRITE_SKIP:
        return "write every n pages";
    default:
        permAssert(false);
    }
}

LockMode PagingTestBase::getLockMode

(

OpType

opType

)

[inherited]

Gets the LockMode corresponding to an OpType.

Definition at line 143 of file PagingTestBase.cpp.

References LOCKMODE_S, LOCKMODE_S_NOWAIT, LOCKMODE_X, LOCKMODE_X_NOWAIT, PagingTestBase::OP_ALLOCATE, PagingTestBase::OP_READ_NOWAIT, PagingTestBase::OP_READ_RAND, PagingTestBase::OP_READ_SEQ, PagingTestBase::OP_WRITE_NOWAIT, PagingTestBase::OP_WRITE_RAND, PagingTestBase::OP_WRITE_SEQ, and PagingTestBase::OP_WRITE_SKIP.

Referenced by SegmentTestBase::lockPage(), CacheTest::lockPage(), and PagingTestBase::testOp().

{
    switch (opType) {
    case OP_ALLOCATE:
        return LOCKMODE_X;
    case OP_READ_SEQ:
        return LOCKMODE_S;
    case OP_WRITE_SEQ:
        return LOCKMODE_X;
    case OP_READ_RAND:
        return LOCKMODE_S;
    case OP_WRITE_RAND:
        return LOCKMODE_X;
    case OP_READ_NOWAIT:
        return LOCKMODE_S_NOWAIT;
    case OP_WRITE_NOWAIT:
        return LOCKMODE_X_NOWAIT;
    case OP_WRITE_SKIP:
        return LOCKMODE_X;
    default:
        permAssert(false);
    }
}

void PagingTestBase::testSequentialOp

(

OpType

opType

)

[inherited]

Carries out an operation on each disk page in order from 0 to nDiskPages-1.

Parameters:

opType

see testOp

Definition at line 167 of file PagingTestBase.cpp.

References PagingTestBase::getOpName(), PagingTestBase::logMutex, CacheTestBase::nDiskPages, and PagingTestBase::testOp().

Referenced by PagingTestBase::testAllocateAll(), PagingTestBase::testSequentialRead(), PagingTestBase::testSequentialWrite(), and PagingTestBase::testThreadedOp().

{
    uint n = 0;
    for (uint i = 0; i < nDiskPages; i++) {
        if (testOp(opType,i,true)) {
            n++;
        }
    }
    StrictMutexGuard mutexGuard(logMutex);
    BOOST_MESSAGE(
        "completed " << n << " " << getOpName(opType) << " ops");
}

void PagingTestBase::testRandomOp

(

OpType

opType

)

[inherited]

Carries out an operation on nRandomOps pages selected at random.

Parameters:

opType

see testOp

Definition at line 180 of file PagingTestBase.cpp.

References PagingTestBase::generateRandomNumber(), PagingTestBase::getOpName(), PagingTestBase::logMutex, CacheTestBase::nDiskPages, PagingTestBase::nRandomOps, and PagingTestBase::testOp().

Referenced by PagingTestBase::testRandomRead(), PagingTestBase::testRandomWrite(), and PagingTestBase::testThreadedOp().

{
    uint n = 0;
    for (uint i = 0; i < nRandomOps; i++) {
        uint iPage = generateRandomNumber(nDiskPages);
        bool bNice = (generateRandomNumber(nRandomOps) == 0);
        if (testOp(opType,iPage,bNice)) {
            n++;
        }
    }
    StrictMutexGuard mutexGuard(logMutex);
    BOOST_MESSAGE(
        "completed " << n << " " << getOpName(opType) << " ops");

}

void PagingTestBase::testSkipOp	(	OpType	opType,
		uint	n
	)			[inherited]

Carries out an operation on every "n" pages, starting at page 0.

Parameters:

	opType	see testOp
	n	the offset between each page

Definition at line 196 of file PagingTestBase.cpp.

References PagingTestBase::getOpName(), PagingTestBase::logMutex, CacheTestBase::nDiskPages, and PagingTestBase::testOp().

Referenced by PagingTestBase::testSkipWrite(), and PagingTestBase::testThreadedOp().

{
    uint numOps = 0;
    for (uint i = 0; i < nDiskPages; i += n) {
        if (testOp(opType,i,true)) {
            numOps++;
        }
    }
    StrictMutexGuard mutexGuard(logMutex);
    BOOST_MESSAGE(
        "completed " << numOps << " " << getOpName(opType) << " ops");
}

void PagingTestBase::testScratch

(

)

[inherited]

Performs nRandomOps scratch operations.

A scratch operation consists of locking a scratch page, filling it with random data, and then unlocking it.

Definition at line 209 of file PagingTestBase.cpp.

References PagingTestBase::fillPage(), PagingTestBase::generateRandomNumber(), CacheTestBase::getCache(), LOCKMODE_X, PagingTestBase::logMutex, PagingTestBase::nRandomOps, and CacheAccessor::unlockPage().

Referenced by CacheTest::testSingleThread(), and PagingTestBase::testThreadedOp().

{
    for (uint i = 0; i < nRandomOps; i++) {
        CachePage &page = getCache().lockScratchPage();
        fillPage(page,generateRandomNumber(10000));
        getCache().unlockPage(page,LOCKMODE_X);
    }
    StrictMutexGuard mutexGuard(logMutex);
    BOOST_MESSAGE("completed " << nRandomOps << " random scratch ops");
}

void PagingTestBase::testPrefetch

(

)

[inherited]

Performs a limited number of prefetch operations.

Prefetches are not verified.

Definition at line 220 of file PagingTestBase.cpp.

References PagingTestBase::generateRandomNumber(), PagingTestBase::logMutex, CacheTestBase::nDiskPages, PagingTestBase::prefetchPage(), and TestBase::snooze().

Referenced by PagingTestBase::testThreadedOp().

{
    // TODO: parameterize this
    uint n = 3;
    for (uint i = 0; i < n; i++) {
        uint iPage = generateRandomNumber(nDiskPages);
        prefetchPage(iPage);
    }
    // give the prefetches a chance to complete
    snooze(1);
    StrictMutexGuard mutexGuard(logMutex);
    BOOST_MESSAGE("completed " << n << " random prefetch ops");
}

void PagingTestBase::testPrefetchBatch

(

)

[inherited]

Performs a limited number of batch prefetch operations.

Prefetches are not verified.

Definition at line 234 of file PagingTestBase.cpp.

References PagingTestBase::generateRandomNumber(), PagingTestBase::logMutex, CacheTestBase::nDiskPages, PagingTestBase::prefetchBatch(), and TestBase::snooze().

Referenced by PagingTestBase::testThreadedOp().

{
    // TODO: parameterize this
    uint n = 2;
    uint nPagesPerBatch = 4;
    for (uint i = 0; i < n; i++) {
        uint iPage = generateRandomNumber(nDiskPages - nPagesPerBatch);
        prefetchBatch(iPage,nPagesPerBatch);
    }
    // give the prefetches a chance to complete
    snooze(1);
    StrictMutexGuard mutexGuard(logMutex);
    BOOST_MESSAGE("completed " << n << " random prefetch batch ops");
}

void PagingTestBase::testSequentialRead

(

)

[inherited]

Carries out one sequential read pass over the entire device.

Definition at line 254 of file PagingTestBase.cpp.

References PagingTestBase::OP_READ_SEQ, and PagingTestBase::testSequentialOp().

Referenced by SnapshotSegmentTest::deallocateOldPages(), SnapshotSegmentTest::testDeallocateOld(), VersionedSegmentTest::testRecovery(), SnapshotSegmentTest::testRollback(), SegmentTestBase::testSingleThread(), CacheTest::testSingleThread(), SnapshotSegmentTest::testSnapshotReads(), SnapshotSegmentTest::testUncommittedReads(), and verifyData().

{
    testSequentialOp(OP_READ_SEQ);
}

void PagingTestBase::testSequentialWrite

(

)

[inherited]

Carries out one sequential write pass over the entire device.

Definition at line 259 of file PagingTestBase.cpp.

References PagingTestBase::OP_WRITE_SEQ, and PagingTestBase::testSequentialOp().

Referenced by SegmentTestBase::testSingleThread(), and CacheTest::testSingleThread().

{
    testSequentialOp(OP_WRITE_SEQ);
}

void PagingTestBase::testRandomRead

(

)

[inherited]

Carries out nRandomOps read operations on pages selected at random.

Definition at line 264 of file PagingTestBase.cpp.

References PagingTestBase::OP_READ_RAND, and PagingTestBase::testRandomOp().

Referenced by SegmentTestBase::testSingleThread(), and CacheTest::testSingleThread().

{
    testRandomOp(OP_READ_RAND);
}

void PagingTestBase::testRandomWrite

(

)

[inherited]

Carries out nRandomOps write operations on pages selected at random.

Definition at line 269 of file PagingTestBase.cpp.

References PagingTestBase::OP_WRITE_RAND, and PagingTestBase::testRandomOp().

Referenced by SegmentTestBase::testSingleThread(), and CacheTest::testSingleThread().

{
    testRandomOp(OP_WRITE_RAND);
}

void PagingTestBase::testSkipWrite

(

uint

n

)

[inherited]

Carries out write operations every n pages.

Parameters:

n

offset between pages

Definition at line 274 of file PagingTestBase.cpp.

References PagingTestBase::OP_WRITE_SKIP, and PagingTestBase::testSkipOp().

Referenced by testBackupRestore(), SnapshotSegmentTest::testDeallocateOld(), SnapshotSegmentTest::testRollback(), SnapshotSegmentTest::testSnapshotReads(), and SnapshotSegmentTest::testUncommittedReads().

{
    testSkipOp(OP_WRITE_SKIP, n);
}

void PagingTestBase::testCheckpointGuarded

(

)

[inherited]

Definition at line 295 of file PagingTestBase.cpp.

References PagingTestBase::checkpointMutex, PagingTestBase::logMutex, PagingTestBase::nSecondsBetweenCheckpoints, TestBase::snooze(), PagingTestBase::testCheckpoint(), and SXMutexGuard< lockMode >::unlock().

Referenced by PagingTestBase::testThreadedOp().

{
    snooze(nSecondsBetweenCheckpoints);
    StrictMutexGuard logGuard(logMutex);
    BOOST_MESSAGE("checkpoint started");
    logGuard.unlock();
    SXMutexExclusiveGuard checkpointExclusiveGuard(checkpointMutex);
    testCheckpoint();
    checkpointExclusiveGuard.unlock();
    logGuard.lock();
    BOOST_MESSAGE("checkpoint completed");
}

void PagingTestBase::testCacheResize

(

)

[inherited]

Definition at line 308 of file PagingTestBase.cpp.

References CacheTestBase::getCache(), PagingTestBase::logMutex, CacheTestBase::nMemPages, ThreadedTestBase::nSeconds, Cache::setAllocatedPageCount(), and TestBase::snooze().

Referenced by PagingTestBase::testThreadedOp().

{
    snooze(nSeconds / 3);
    getCache().setAllocatedPageCount(nMemPages / 2);
    StrictMutexGuard mutexGuard(logMutex);
    BOOST_MESSAGE("shrank cache");
    mutexGuard.unlock();
    snooze(nSeconds / 3);
    getCache().setAllocatedPageCount(nMemPages - 1);
    mutexGuard.lock();
    BOOST_MESSAGE("expanded cache");
    mutexGuard.unlock();
}

void PagingTestBase::testMultipleThreads

(

)

[inherited]

Carries out specified tests in multi-threaded mode.

Definition at line 431 of file PagingTestBase.cpp.

References DeviceMode::createNew, CacheTestBase::openStorage(), ThreadedTestBase::runThreadedTestCase(), and PagingTestBase::testAllocateAll().

Referenced by CacheTest::CacheTest(), LinearDeviceSegmentTest::LinearDeviceSegmentTest(), LinearViewSegmentTest::LinearViewSegmentTest(), SnapshotSegmentTest::SnapshotSegmentTest(), and VersionedSegmentTest::VersionedSegmentTest().

{
    openStorage(DeviceMode::createNew);
    testAllocateAll();
    runThreadedTestCase();
}

void PagingTestBase::threadInit

(

)

[virtual, inherited]

Reimplemented from ThreadedTestBase.

Definition at line 41 of file PagingTestBase.cpp.

References g_pRNG, and ThreadedTestBase::threadInit().

Referenced by PagingTestBase::PagingTestBase().

{
    ThreadedTestBase::threadInit();
    g_pRNG.reset(new std::subtractive_rng());
}

void PagingTestBase::threadTerminate

(

)

[virtual, inherited]

Reimplemented from ThreadedTestBase.

Definition at line 47 of file PagingTestBase.cpp.

References g_pRNG, and ThreadedTestBase::threadTerminate().

Referenced by PagingTestBase::~PagingTestBase().

{
    g_pRNG.reset();
    ThreadedTestBase::threadTerminate();
}

bool PagingTestBase::testThreadedOp

(

int

iOp

)

[virtual, inherited]

Test implementation must be supplied by derived test class.

Parameters:

iOp

operation type to test

Returns:

true if test should run again

Implements ThreadedTestBase.

Definition at line 378 of file PagingTestBase.cpp.

References PagingTestBase::checkpointMutex, SXMutexGuard< lockMode >::lock(), PagingTestBase::OP_ALLOCATE, PagingTestBase::OP_CHECKPOINT, PagingTestBase::OP_DEALLOCATE, PagingTestBase::OP_MAX, PagingTestBase::OP_PREFETCH, PagingTestBase::OP_PREFETCH_BATCH, PagingTestBase::OP_READ_NOWAIT, PagingTestBase::OP_READ_RAND, PagingTestBase::OP_READ_SEQ, PagingTestBase::OP_RESIZE_CACHE, PagingTestBase::OP_SCRATCH, PagingTestBase::OP_WRITE_NOWAIT, PagingTestBase::OP_WRITE_RAND, PagingTestBase::OP_WRITE_SEQ, PagingTestBase::OP_WRITE_SKIP, PagingTestBase::testAllocate(), PagingTestBase::testCacheResize(), PagingTestBase::testCheckpointGuarded(), PagingTestBase::testDeallocate(), PagingTestBase::testPrefetch(), PagingTestBase::testPrefetchBatch(), PagingTestBase::testRandomOp(), PagingTestBase::testScratch(), PagingTestBase::testSequentialOp(), and PagingTestBase::testSkipOp().

{
    SXMutexSharedGuard checkpointSharedGuard(checkpointMutex,false);
    assert(iOp < OP_MAX);
    OpType op = static_cast<OpType>(iOp);
    switch (op) {
    case PagingTestBase::OP_WRITE_SEQ:
        checkpointSharedGuard.lock();
        // fall through
    case PagingTestBase::OP_READ_SEQ:
        testSequentialOp(op);
        break;
    case PagingTestBase::OP_WRITE_RAND:
    case PagingTestBase::OP_WRITE_NOWAIT:
        checkpointSharedGuard.lock();
        // fall through
    case PagingTestBase::OP_READ_RAND:
    case PagingTestBase::OP_READ_NOWAIT:
        testRandomOp(op);
        break;
    case PagingTestBase::OP_WRITE_SKIP:
        checkpointSharedGuard.lock();
        testSkipOp(op, 5);
        break;
    case PagingTestBase::OP_SCRATCH:
        testScratch();
        break;
    case PagingTestBase::OP_PREFETCH:
        testPrefetch();
        break;
    case PagingTestBase::OP_PREFETCH_BATCH:
        testPrefetchBatch();
        break;
    case PagingTestBase::OP_ALLOCATE:
        checkpointSharedGuard.lock();
        testAllocate();
        break;
    case PagingTestBase::OP_DEALLOCATE:
        checkpointSharedGuard.lock();
        testDeallocate();
        break;
    case PagingTestBase::OP_CHECKPOINT:
        testCheckpointGuarded();
        break;
    case PagingTestBase::OP_RESIZE_CACHE:
        testCacheResize();
        return false;
    default:
        permAssert(false);
    }
    return true;
}

void ThreadedTestBase::runThreadedTestCase

(

)

[protected, inherited]

Executes specified test threads.

Definition at line 43 of file ThreadedTestBase.cpp.

References ThreadedTestBase::bDone, ThreadedTestBase::defaultThreadCount, ThreadedTestBase::nSeconds, ThreadedTestBase::pStartBarrier, TestBase::snooze(), ThreadPoolBase::start(), ThreadPoolBase::stop(), ThreadPool< Task >::submitTask(), and ThreadedTestBase::threadCounts.

Referenced by PagingTestBase::testMultipleThreads(), and BTreeTxnTest::testTxns().

{
    bDone = false;

    // materialize default thread counts
    std::replace_if(
        threadCounts.begin(),
        threadCounts.end(),
        std::bind2nd(std::equal_to<int>(),-1),
        defaultThreadCount);

    // calculate how many threads are needed
    int nThreads = std::accumulate(
        threadCounts.begin(),
        threadCounts.end(),
        0);

    // initialize a barrier to make sure they all start at once
    pStartBarrier.reset(new boost::barrier(nThreads));

    // fire 'em up
    ThreadPool<ThreadedTestBaseTask> threadPool;
    threadPool.start(nThreads);

    // and distribute the tasks
    for (uint i = 0; i < threadCounts.size(); ++i) {
        for (int j = 0; j < threadCounts[i]; ++j) {
            ThreadedTestBaseTask task(*this,i);
            threadPool.submitTask(task);
        }
    }

    // run the tests for the requested duration
    snooze(nSeconds);

    // tell threads to quit and then wait for them to finish up
    bDone = true;
    threadPool.stop();
}

---

Member Data Documentation

SharedDatabase BackupRestoreTest::pDatabase [private]

Definition at line 54 of file BackupRestoreTest.cpp.

Referenced by createSnapshotData(), executeSnapshotTxn(), testBackupCleanup(), testHeaderBackupRestore(), and verifySnapshotData().

PageId BackupRestoreTest::persistentPageId [private]

Definition at line 55 of file BackupRestoreTest.cpp.

Referenced by createSnapshotData(), executeSnapshotTxn(), and verifySnapshotData().

uint SnapshotSegmentTestBase::nDiskPagesTotal [protected, inherited]

Definition at line 39 of file SnapshotSegmentTestBase.h.

Referenced by SnapshotSegmentTestBase::openSegmentStorage(), and SnapshotSegmentTestBase::SnapshotSegmentTestBase().

PageId SnapshotSegmentTestBase::firstPageId [protected, inherited]

Definition at line 40 of file SnapshotSegmentTestBase.h.

Referenced by SnapshotSegmentTestBase::openSegmentStorage(), SnapshotSegmentTestBase::testAllocateAll(), SnapshotSegmentTest::testDeallocateOld(), and SnapshotSegmentTest::testUncommittedReads().

DeviceId SnapshotSegmentTestBase::tempDeviceId [protected, inherited]

Definition at line 41 of file SnapshotSegmentTestBase.h.

Referenced by SnapshotSegmentTestBase::closeStorage(), SnapshotSegmentTestBase::openSegmentStorage(), and SnapshotSegmentTestBase::SnapshotSegmentTestBase().

SharedRandomAccessDevice SnapshotSegmentTestBase::pTempDevice [protected, inherited]

Definition at line 42 of file SnapshotSegmentTestBase.h.

Referenced by SnapshotSegmentTestBase::closeStorage(), and SnapshotSegmentTestBase::openSegmentStorage().

SharedSegment SnapshotSegmentTestBase::pTempSegment [protected, inherited]

Definition at line 43 of file SnapshotSegmentTestBase.h.

Referenced by SnapshotSegmentTestBase::closeStorage(), and SnapshotSegmentTestBase::openSegmentStorage().

TxnId SnapshotSegmentTestBase::currCsn [protected, inherited]

Definition at line 44 of file SnapshotSegmentTestBase.h.

Referenced by SnapshotSegmentTestBase::closeStorage(), SnapshotSegmentTest::deallocateOldPages(), SnapshotSegmentTestBase::fillPage(), SnapshotSegmentTestBase::openSegmentStorage(), testBackupRestore(), SnapshotSegmentTestBase::testCaseSetUp(), LcsClusterReplaceExecStreamTest::testClusterReplace(), SnapshotSegmentTest::testDeallocateOld(), SnapshotSegmentTest::testRollback(), SnapshotSegmentTest::testSnapshotReads(), SnapshotSegmentTest::testUncommittedReads(), and SnapshotSegmentTestBase::verifyPage().

std::vector<TxnId> SnapshotSegmentTestBase::updatedCsns [protected, inherited]

Definition at line 45 of file SnapshotSegmentTestBase.h.

Referenced by testBackupRestore(), SnapshotSegmentTestBase::testCaseSetUp(), SnapshotSegmentTest::testDeallocateOld(), SnapshotSegmentTest::testSnapshotReads(), SnapshotSegmentTest::testUncommittedReads(), and SnapshotSegmentTestBase::verifyPage().

bool SnapshotSegmentTestBase::commit [protected, inherited]

Definition at line 46 of file SnapshotSegmentTestBase.h.

Referenced by SnapshotSegmentTestBase::commitChanges(), SnapshotSegmentTestBase::testCaseSetUp(), and SnapshotSegmentTest::testRollback().

SharedSegment SnapshotSegmentTestBase::pSnapshotRandomSegment2 [protected, inherited]

Definition at line 47 of file SnapshotSegmentTestBase.h.

Referenced by SnapshotSegmentTestBase::closeStorage(), LcsClusterReplaceExecStreamTest::testClusterReplace(), and SnapshotSegmentTest::testUncommittedReads().

std::vector<PageId> SegmentTestBase::freeablePages [protected, inherited]

Queue of allocated pages waiting to be freed.

Definition at line 44 of file SegmentTestBase.h.

Referenced by SegmentTestBase::testAllocate(), SegmentTestBase::testDeallocate(), and SegmentTestBase::testSingleThread().

StrictMutex SegmentTestBase::freeablePagesMutex [protected, inherited]

Mutex protecting freeablePages.

Definition at line 49 of file SegmentTestBase.h.

Referenced by SegmentTestBase::testAllocate(), and SegmentTestBase::testDeallocate().

PageOwnerId SegmentTestBase::objId [protected, inherited]

PageOwnerId to use when allocating pages.

Definition at line 54 of file SegmentTestBase.h.

Referenced by SegmentTestBase::lockPage(), SegmentTestBase::SegmentTestBase(), and SegmentTestBase::testAllocate().

SharedSegmentFactory SegStorageTestBase::pSegmentFactory [protected, inherited]

Definition at line 40 of file SegStorageTestBase.h.

Referenced by backup(), SegStorageTestBase::createLinearDeviceSegment(), LogicalTxnTest::createRecoveryLog(), LbmSearchTest::initBTreeExecStreamParam(), LbmLoadBitmapTest::initBTreeExecStreamParam(), LcsClusterReplaceExecStreamTest::initClusterAppendParams(), LbmExecStreamTestBase::initSorterExecStream(), LcsMultiClusterAppendTest::loadClusters(), LcsRowScanExecStreamTest::loadOneCluster(), LbmSearchTest::loadTableAndIndex(), LbmMinusExecStreamTest::newMinusStream(), ExecStreamTestBase::newStreamGraphEmbryo(), SegStorageTestBase::openRandomSegment(), VersionedSegmentTest::openSegmentStorage(), SnapshotSegmentTestBase::openSegmentStorage(), LinearViewSegmentTest::openSegmentStorage(), restore(), SegStorageTestBase::SegStorageTestBase(), LbmSplicerExecStreamTest::spliceInput(), ExecStreamTestSuite::testBTreeInsertExecStream(), LhxHashTableTest::testCaseSetUp(), LcsClusterReplaceExecStreamTest::testClusterReplace(), LhxAggExecStreamTest::testCountImpl(), ExecStreamTestSuite::testDoubleBufferExecStream(), ExecStreamGovernorTest::testGovernor(), LhxAggExecStreamTest::testGroupCountImpl(), LhxJoinExecStreamTest::testImpl(), ExternalSortExecStreamTest::testImpl(), BTreeTest::testInserts(), LbmIntersectExecStreamTest::testIntersect(), LbmEntryTest::testldb35(), LbmEntryTest::testler5920(), LbmLoadBitmapTest::testLoad(), LcsClusterAppendExecStreamTest::testLoadMultiCol(), LcsClusterAppendExecStreamTest::testLoadSingleCol(), LbmEntryTest::testMergeEntry(), BTreeTest::testMultiKeySearches(), BTreeTest::testScan(), ExecStreamTestSuite::testScratchBufferExecStream(), LhxAggExecStreamTest::testSingleValueImpl(), FlatFileExecStreamTest::testStream(), LhxAggExecStreamTest::testSumImpl(), LogicalTxnTest::testTxn(), SnapshotSegmentTest::testUncommittedReads(), LbmUnionExecStreamTest::testUnion(), SegStreamTest::testWriteSpillAndRead(), and LbmEntryTest::testZeroBytes().

SharedSegment SegStorageTestBase::pLinearSegment [protected, inherited]

Segment supporting linear page allocation.

Definition at line 45 of file SegStorageTestBase.h.

Referenced by SegStorageTestBase::closeLinearSegment(), LogicalTxnTest::createRecoveryLog(), SegmentTestBase::lockPage(), SegStorageTestBase::openRandomSegment(), VersionedSegmentTest::openSegmentStorage(), SnapshotSegmentTestBase::openSegmentStorage(), SegStorageTestBase::openSegmentStorage(), LinearViewSegmentTest::openSegmentStorage(), SegmentTestBase::openStorage(), SegmentTestBase::prefetchPage(), SnapshotSegmentTestBase::testAllocateAll(), LinearViewSegmentTest::testAllocateAll(), VersionedSegmentTest::testCheckpoint(), SegmentTestBase::testCheckpoint(), SegPageIterTest::testIter(), SegPageEntryIterTest::testIter(), SegStreamTest::testMarkReset(), SegStreamTest::testReadSeg(), VersionedSegmentTest::testRecovery(), LogicalTxnTest::testTxn(), SnapshotSegmentTest::testUncommittedReads(), SegStreamTest::testWriteSeg(), and VersionedSegmentTest::verifyPage().

SharedSegment SegStorageTestBase::pRandomSegment [protected, inherited]

(Optional) segment supporting random page allocation.

Definition at line 50 of file SegStorageTestBase.h.

Referenced by SegStorageTestBase::closeRandomSegment(), SnapshotSegmentTestBase::closeStorage(), LbmSplicerExecStreamTest::createBTree(), LbmSplicerExecStreamTest::initBTreeParam(), LbmSearchTest::initBTreeParam(), LbmLoadBitmapTest::initBTreeParam(), LbmLoadBitmapTest::initBTreeTupleDesc(), LcsClusterReplaceExecStreamTest::initClusterAppendParams(), LbmExecStreamTestBase::initSorterExecStream(), LcsClusterReplaceExecStreamTest::loadCluster(), LcsMultiClusterAppendTest::loadClusters(), LcsRowScanExecStreamTest::loadOneCluster(), LbmSearchTest::loadTableAndIndex(), SegStorageTestBase::openRandomSegment(), SnapshotSegmentTestBase::openSegmentStorage(), LinearViewSegmentTest::openSegmentStorage(), SegmentTestBase::openStorage(), SegmentTestBase::testAllocate(), RandomAllocationSegmentTest::testAllocateAndDeallocate(), ExecStreamTestSuite::testBTreeInsertExecStream(), BTreeTest::testBulkLoad(), LhxHashTableTest::testCaseSetUp(), BTreeTest::testCaseSetUp(), BTreeReadersTest::testCaseSetUp(), LcsRowScanExecStreamTest::testCaseSetUp(), LcsMultiClusterAppendTest::testCaseSetUp(), LcsClusterReplaceExecStreamTest::testCaseSetUp(), LcsClusterAppendExecStreamTest::testCaseSetUp(), LbmExecStreamTestBase::testCaseSetUp(), LcsClusterReplaceExecStreamTest::testClusterReplace(), LhxAggExecStreamTest::testCountImpl(), SegmentTestBase::testDeallocate(), LhxAggExecStreamTest::testGroupCountImpl(), LhxJoinExecStreamTest::testImpl(), ExternalSortExecStreamTest::testImpl(), BTreeTest::testInserts(), LbmLoadBitmapTest::testLoad(), LcsClusterAppendExecStreamTest::testLoadMultiCol(), LcsClusterAppendExecStreamTest::testLoadSingleCol(), ExecStreamTestSuite::testMergeImplicitPullInputs(), BTreeTest::testMultiKeySearches(), BTreeReadersTest::testReaders(), LcsRowScanExecStreamTest::testScanOnEmptyCluster(), ExecStreamTestSuite::testSegBufferExecStream(), ExecStreamTestSuite::testSegBufferReaderWriterExecStream(), LhxAggExecStreamTest::testSingleValueImpl(), LhxAggExecStreamTest::testSumImpl(), and LbmUnionExecStreamTest::testUnion().

SharedSegment SegStorageTestBase::pVersionedRandomSegment [protected, inherited]

(Optional) segment supporting versioned random page allocation.

Definition at line 55 of file SegStorageTestBase.h.

Referenced by backup(), SnapshotSegmentTestBase::closeStorage(), SegStorageTestBase::closeVersionedRandomSegment(), SnapshotSegmentTest::deallocateOldPages(), SnapshotSegmentTestBase::openSegmentStorage(), restore(), LcsClusterReplaceExecStreamTest::testClusterReplace(), SnapshotSegmentTest::testRollback(), and SnapshotSegmentTest::testUncommittedReads().

SharedSegment SegStorageTestBase::pSnapshotRandomSegment [protected, inherited]

(Optional) segment supporting snapshot random page allocation.

Definition at line 60 of file SegStorageTestBase.h.

Referenced by SegStorageTestBase::closeSnapshotRandomSegment(), SnapshotSegmentTestBase::commitChanges(), SnapshotSegmentTestBase::openSegmentStorage(), LcsClusterReplaceExecStreamTest::testClusterReplace(), and SnapshotSegmentTest::testDeallocateOld().

VictimPolicy CacheTestBase::victimPolicy [protected, inherited]

VictimPolicy to instantiate.

Definition at line 53 of file CacheTestBase.h.

Referenced by CacheTestBase::CacheTestBase(), and CacheTestBase::newCache().

CacheParams CacheTestBase::cacheParams [protected, inherited]

Parameters for cache initialization.

Definition at line 58 of file CacheTestBase.h.

Referenced by CacheTestBase::CacheTestBase(), CacheTestBase::newCache(), testBackupCleanup(), testHeaderBackupRestore(), and SegPageEntryIterTest::testIter().

SharedCache CacheTestBase::pCache [protected, inherited]

Cache instance being tested.

Definition at line 63 of file CacheTestBase.h.

Referenced by backup(), CacheTestBase::closeDevice(), CacheTestBase::closeStorage(), LbmSplicerExecStreamTest::createBTree(), SegStorageTestBase::createLinearDeviceSegment(), LogicalTxnTest::createRecoveryLog(), createSnapshotData(), executeSnapshotTxn(), CacheTestBase::getCache(), LbmSearchTest::initBTreeExecStreamParam(), LbmLoadBitmapTest::initBTreeExecStreamParam(), LbmSearchTest::initBTreeParam(), LbmLoadBitmapTest::initBTreeParam(), LcsClusterReplaceExecStreamTest::initClusterAppendParams(), LbmExecStreamTestBase::initSorterExecStream(), LcsClusterReplaceExecStreamTest::loadCluster(), LcsMultiClusterAppendTest::loadClusters(), LcsRowScanExecStreamTest::loadOneCluster(), LbmSearchTest::loadTableAndIndex(), SegmentTestBase::lockPage(), LbmMinusExecStreamTest::newMinusStream(), ExecStreamTestBase::newStreamGraphEmbryo(), CacheTestBase::openDevice(), CacheTestBase::openStorage(), LcsClusterReplaceExecStreamTest::replaceCluster(), restore(), LbmSplicerExecStreamTest::spliceInput(), SegmentTestBase::testAllocate(), RandomAllocationSegmentTest::testAllocateAndDeallocate(), testBackupCleanup(), ExecStreamTestSuite::testBTreeInsertExecStream(), BTreeTest::testBulkLoad(), LhxHashTableTest::testCaseSetUp(), ExecStreamUnitTestBase::testCaseSetUp(), BTreeTest::testCaseSetUp(), BTreeReadersTest::testCaseSetUp(), LhxAggExecStreamTest::testCountImpl(), SegmentTestBase::testDeallocate(), SnapshotSegmentTest::testDeallocateOld(), ExecStreamTestSuite::testDoubleBufferExecStream(), ExecStreamGovernorTest::testGovernor(), LhxAggExecStreamTest::testGroupCountImpl(), testHeaderBackupRestore(), LhxJoinExecStreamTest::testImpl(), ExternalSortExecStreamTest::testImpl(), BTreeTest::testInserts(), LbmIntersectExecStreamTest::testIntersect(), SegPageIterTest::testIter(), SegPageEntryIterTest::testIter(), CacheTest::testLargeCacheInit(), CacheTest::testLargeCacheRequest(), LbmEntryTest::testldb35(), LbmEntryTest::testler5920(), LbmLoadBitmapTest::testLoad(), LcsClusterAppendExecStreamTest::testLoadMultiCol(), LcsClusterAppendExecStreamTest::testLoadSingleCol(), SegStreamTest::testMarkReset(), LbmEntryTest::testMergeEntry(), BTreeTest::testMultiKeySearches(), CacheTest::testQuotaCacheAccessor(), BTreeReadersTest::testReaders(), SegStreamTest::testReadSeg(), BTreeTest::testScan(), LcsRowScanExecStreamTest::testScanOnEmptyCluster(), ExecStreamTestSuite::testScratchBufferExecStream(), LhxAggExecStreamTest::testSingleValueImpl(), FlatFileExecStreamTest::testStream(), LhxAggExecStreamTest::testSumImpl(), LogicalTxnTest::testTxn(), LogicalTxnTest::testTxnIdSequence(), LbmUnionExecStreamTest::testUnion(), SegStreamTest::testWriteSeg(), SegStreamTest::testWriteSpillAndRead(), LbmEntryTest::testZeroBytes(), and verifySnapshotData().

SharedRandomAccessDevice CacheTestBase::pRandomAccessDevice [protected, inherited]

The default cached device.

Definition at line 68 of file CacheTestBase.h.

Referenced by backup(), CacheTestBase::closeStorage(), SegStorageTestBase::openSegmentStorage(), CacheTestBase::openStorage(), and restore().

uint CacheTestBase::nMemPages [protected, inherited]

Size of cache in memory pages.

Definition at line 73 of file CacheTestBase.h.

Referenced by CacheTestBase::CacheTestBase(), PagingTestBase::testCacheResize(), and ExecStreamTestBase::testCaseSetUp().

uint CacheTestBase::nDiskPages [protected, inherited]

Size of device in disk pages.

Definition at line 78 of file CacheTestBase.h.

Referenced by CacheTestBase::CacheTestBase(), LinearViewSegmentTest::LinearViewSegmentTest(), CacheTest::makeBlockId(), VersionedSegmentTest::openSegmentStorage(), SnapshotSegmentTestBase::openSegmentStorage(), LinearViewSegmentTest::openSegmentStorage(), CacheTestBase::openStorage(), SegStreamTest::SegStreamTest(), SnapshotSegmentTestBase::SnapshotSegmentTestBase(), SnapshotSegmentTest::testDeallocateOld(), PagingTestBase::testPrefetch(), PagingTestBase::testPrefetchBatch(), PagingTestBase::testRandomOp(), SnapshotSegmentTest::testRollback(), PagingTestBase::testSequentialOp(), and PagingTestBase::testSkipOp().

uint CacheTestBase::cbPageFull [protected, inherited]

Disk page size.

Definition at line 83 of file CacheTestBase.h.

Referenced by CacheTest::CacheTest(), CacheTestBase::CacheTestBase(), CacheTestBase::openDevice(), and SegStorageTestBase::openSegmentStorage().

DeviceId CacheTestBase::dataDeviceId [protected, inherited]

Fixed ID to assign to data device.

Definition at line 88 of file CacheTestBase.h.

Referenced by CacheTestBase::CacheTestBase(), CacheTestBase::closeStorage(), CacheTest::makeBlockId(), SnapshotSegmentTestBase::openSegmentStorage(), SegStorageTestBase::openSegmentStorage(), LinearViewSegmentTest::openSegmentStorage(), CacheTestBase::openStorage(), and PagingTestBase::testCheckpoint().

TestSuite* TestBase::pTestSuite [protected, inherited]

Boost test suite.

Definition at line 59 of file TestBase.h.

Referenced by TestBase::releaseTestSuite().

boost::shared_ptr<TestBase> TestBase::pTestObj [protected, inherited]

Definition at line 61 of file TestBase.h.

Referenced by TestBase::releaseTestSuite(), and TestBase::TestBase().

std::ofstream TestBase::traceStream [protected, inherited]

Output file stream for tracing.

Definition at line 66 of file TestBase.h.

Referenced by TestBase::notifyTrace(), TestBase::TestBase(), and TestBase::~TestBase().

StrictMutex TestBase::traceMutex [protected, inherited]

Protects traceStream.

Definition at line 71 of file TestBase.h.

Referenced by TestBase::notifyTrace().

std::string TestBase::testName [protected, inherited]

Name of test.

Definition at line 76 of file TestBase.h.

Referenced by TestBase::afterTestCase(), TestBase::beforeTestCase(), TestBase::releaseTestSuite(), TestBase::TestBase(), LhxHashTableTest::testInsert1Ka(), and LhxHashTableTest::testInsert1Kb().

TraceLevel TestBase::traceLevel [protected, inherited]

Level at which to trace test execution.

Definition at line 81 of file TestBase.h.

Referenced by TestBase::getSourceTraceLevel(), and TestBase::TestBase().

FileStatsTarget TestBase::statsTarget [protected, inherited]

Output for stats.

Definition at line 86 of file TestBase.h.

StatsTimer TestBase::statsTimer [protected, inherited]

Timer for stats collection.

Definition at line 91 of file TestBase.h.

Referenced by CacheTestBase::closeStorage(), CacheTestBase::openStorage(), BTreeTxnTest::testCaseSetUp(), BTreeTxnTest::testCaseTearDown(), and BTreeTxnTest::testTxns().

bool TestBase::traceStdout [protected, inherited]

Copy trace output to stdout.

Definition at line 99 of file TestBase.h.

Referenced by TestBase::notifyTrace(), and TestBase::TestBase().

bool TestBase::traceFile [protected, inherited]

Copy trace output to file.

Definition at line 104 of file TestBase.h.

Referenced by TestBase::notifyTrace(), and TestBase::TestBase().

bool TestBase::runAll [static, protected, inherited]

Run all test cases, including the extra tests.

(static, since set by readParams())

Definition at line 110 of file TestBase.h.

Referenced by TestBase::readParams(), and TestBase::releaseTestSuite().

std::string TestBase::runSingle [static, protected, inherited]

Run only the test case of this name.

(static, since set by readParams())

Definition at line 116 of file TestBase.h.

Referenced by TestBase::readParams(), and TestBase::releaseTestSuite().

TestCaseGroup TestBase::defaultTests [protected, inherited]

Definition at line 139 of file TestBase.h.

Referenced by TestBase::releaseTestSuite().

TestCaseGroup TestBase::extraTests [protected, inherited]

Definition at line 140 of file TestBase.h.

Referenced by TestBase::releaseTestSuite().

ParamName TestBase::paramTestSuiteName [static, inherited]

Definition at line 143 of file TestBase.h.

Referenced by TestBase::TestBase().

ParamName TestBase::paramTraceFileName [static, inherited]

Definition at line 144 of file TestBase.h.

Referenced by TestBase::TestBase().

ParamName TestBase::paramDictionaryFileName [static, inherited]

Definition at line 145 of file TestBase.h.

Referenced by TestBase::readParams(), SegStreamTest::testRead(), and SegStreamTest::testWrite().

ParamName TestBase::paramTraceLevel [static, inherited]

Definition at line 146 of file TestBase.h.

Referenced by TestBase::TestBase().

ParamName TestBase::paramStatsFileName [static, inherited]

Definition at line 147 of file TestBase.h.

ParamName TestBase::paramTraceStdout [static, inherited]

Definition at line 148 of file TestBase.h.

Referenced by TestBase::TestBase().

ParamName TestBase::paramDegreeOfParallelism [static, inherited]

Definition at line 149 of file TestBase.h.

Referenced by ParallelExecStreamSchedulerTest::ParallelExecStreamSchedulerTest().

ConfigMap TestBase::configMap [static, inherited]

Configuration parameters.

The reason this is static is so that no constructor parameters (which burden virtual bases) are needed.

Definition at line 155 of file TestBase.h.

Referenced by TestBase::afterTestCase(), TestBase::beforeTestCase(), BTreeTxnTest::BTreeTxnTest(), CacheTestBase::CacheTestBase(), createSnapshotData(), DatabaseTest::DatabaseTest(), TestOptionsTest::extra(), DatabaseTest::loadDatabase(), SparseBitmapTest::openStorage(), PagingTestBase::PagingTestBase(), ParallelExecStreamSchedulerTest::ParallelExecStreamSchedulerTest(), RandomAccessFileDeviceTest::RandomAccessFileDeviceTest(), TestBase::readParams(), SegStorageTestBase::SegStorageTestBase(), TestOptionsTest::test1(), TestOptionsTest::test2(), testBackupCleanup(), TestBase::TestBase(), BTreeTxnTest::testCaseSetUp(), BTreeTxnTest::testCheckpoint(), DatabaseTest::testCreateEmpty(), DatabaseTest::testForceTxns(), testHeaderBackupRestore(), SegPageEntryIterTest::testIter(), SegStreamTest::testRead(), BTreeTxnTest::testTxns(), SegStreamTest::testWrite(), ThreadedTestBase::ThreadedTestBase(), and TestBase::~TestBase().

uint PagingTestBase::cbPageUsable [protected, inherited]

Portion of each page that should be scribbled on.

Definition at line 49 of file PagingTestBase.h.

Referenced by CacheTest::CacheTest(), PagingTestBase::fillPage(), SegmentTestBase::openStorage(), PagingTestBase::PagingTestBase(), and PagingTestBase::verifyPage().

uint PagingTestBase::nRandomOps [protected, inherited]

Number of random access operations to run per pass.

Definition at line 54 of file PagingTestBase.h.

Referenced by PagingTestBase::PagingTestBase(), SegmentTestBase::testAllocate(), SegmentTestBase::testDeallocate(), PagingTestBase::testRandomOp(), and PagingTestBase::testScratch().

uint PagingTestBase::nSecondsBetweenCheckpoints [protected, inherited]

Checkpoint interval during multi-threaded test.

Definition at line 59 of file PagingTestBase.h.

Referenced by PagingTestBase::PagingTestBase(), and PagingTestBase::testCheckpointGuarded().

StrictMutex PagingTestBase::logMutex [protected, inherited]

Protects output stream.

Definition at line 64 of file PagingTestBase.h.

Referenced by SegmentTestBase::testAllocate(), PagingTestBase::testCacheResize(), PagingTestBase::testCheckpointGuarded(), SegmentTestBase::testDeallocate(), PagingTestBase::testPrefetch(), PagingTestBase::testPrefetchBatch(), PagingTestBase::testRandomOp(), PagingTestBase::testScratch(), PagingTestBase::testSequentialOp(), and PagingTestBase::testSkipOp().

SXMutex PagingTestBase::checkpointMutex [protected, inherited]

SXMutex used to synchronize checkpoints with write actions.

Definition at line 69 of file PagingTestBase.h.

Referenced by PagingTestBase::PagingTestBase(), PagingTestBase::testCheckpointGuarded(), and PagingTestBase::testThreadedOp().

bool PagingTestBase::bTestResize [protected, inherited]

Flag indicating that the cache should be dynamically resized during the multi-threaded portion of the test.

Definition at line 75 of file PagingTestBase.h.

Referenced by PagingTestBase::PagingTestBase().

uint ThreadedTestBase::nSeconds [protected, inherited]

Duration of multi-threaded test.

Definition at line 65 of file ThreadedTestBase.h.

Referenced by BTreeTxnTest::BTreeTxnTest(), PagingTestBase::PagingTestBase(), ThreadedTestBase::runThreadedTestCase(), PagingTestBase::testCacheResize(), and ThreadedTestBase::ThreadedTestBase().

std::vector<int> ThreadedTestBase::threadCounts [protected, inherited]

Number of threads to run for each type of operation.

Definition at line 70 of file ThreadedTestBase.h.

Referenced by BTreeTxnTest::BTreeTxnTest(), CacheTest::CacheTest(), SegmentTestBase::openStorage(), PagingTestBase::PagingTestBase(), ThreadedTestBase::runThreadedTestCase(), and SegmentTestBase::SegmentTestBase().

---

The documentation for this class was generated from the following file:

• /home/pub/open/dev/fennel/test/BackupRestoreTest.cpp

---