DataStorageConfiguration res = new DataStorageConfiguration() .setStoragePath(in.readString()) .setCheckpointFrequency(in.readLong()) .setCheckpointThreads(in.readInt()) .setLockWaitTime((int) in.readLong()) .setWalHistorySize(in.readInt()) .setWalSegments(in.readInt()) .setWalSegmentSize(in.readInt()) .setWalPath(in.readString()) .setWalArchivePath(in.readString()) .setWalMode(WALMode.fromOrdinal(in.readInt())) .setWalThreadLocalBufferSize(in.readInt()) .setWalFlushFrequency((int) in.readLong()) .setWalFsyncDelayNanos(in.readLong()) .setWalRecordIteratorBufferSize(in.readInt()) .setAlwaysWriteFullPages(in.readBoolean()) .setMetricsEnabled(in.readBoolean()) .setMetricsSubIntervalCount(in.readInt()) .setMetricsRateTimeInterval(in.readLong()) .setCheckpointWriteOrder(CheckpointWriteOrder.fromOrdinal(in.readInt())) .setWriteThrottlingEnabled(in.readBoolean()) .setWalCompactionEnabled(in.readBoolean()) .setMaxWalArchiveSize(in.readLong()) .setSystemRegionInitialSize(in.readLong()) .setSystemRegionMaxSize(in.readLong()) .setPageSize(in.readInt()) .setConcurrencyLevel(in.readInt()) .setWalAutoArchiveAfterInactivity(in.readLong());
/** * @return {@code true} if persistence is enabled for at least one data region, {@code false} if not. */ public static boolean isPersistenceEnabled(DataStorageConfiguration cfg) { if (cfg == null) return false; DataRegionConfiguration dfltReg = cfg.getDefaultDataRegionConfiguration(); if (dfltReg == null) return false; if (dfltReg.isPersistenceEnabled()) return true; DataRegionConfiguration[] regCfgs = cfg.getDataRegionConfigurations(); if (regCfgs == null) return false; for (DataRegionConfiguration regCfg : regCfgs) { if (regCfg.isPersistenceEnabled()) return true; } return false; }
/** * Default data storage configuration. */ private DataStorageConfiguration getDataStorageConfiguration() { DataStorageConfiguration dbCfg = new DataStorageConfiguration(); dbCfg.setPageSize(PAGE_SIZE); dbCfg.setFileIOFactory(new SlowIOFactory()); dbCfg.setDefaultDataRegionConfiguration(new DataRegionConfiguration() .setMaxSize(100 * 1024 * 1024) .setPersistenceEnabled(true)); return dbCfg; }
/** * @param memCfg Memory config. */ protected void checkPageSize(DataStorageConfiguration memCfg) { if (memCfg.getPageSize() == 0) memCfg.setPageSize(DFLT_PAGE_SIZE); }
/** * @param memCfg configuration to validate. */ private void validateConfiguration(DataStorageConfiguration memCfg) throws IgniteCheckedException { checkPageSize(memCfg); DataRegionConfiguration[] regCfgs = memCfg.getDataRegionConfigurations(); Set<String> regNames = (regCfgs != null) ? U.<String>newHashSet(regCfgs.length) : new HashSet<String>(0); checkSystemDataRegionSizeConfiguration( memCfg.getSystemRegionInitialSize(), memCfg.getSystemRegionMaxSize() ); if (regCfgs != null) { for (DataRegionConfiguration regCfg : regCfgs) checkDataRegionConfiguration(memCfg, regNames, regCfg); } checkDataRegionConfiguration(memCfg, regNames, memCfg.getDefaultDataRegionConfiguration()); checkWalArchiveSizeConfiguration(memCfg); }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String name) throws Exception { IgniteConfiguration cfg = super.getConfiguration(name); cfg.setConsistentId(name); String storePath = getClass().getSimpleName().toLowerCase() + "/" + getName(); cfg.setDataStorageConfiguration( new DataStorageConfiguration() .setWalMode(WALMode.LOG_ONLY) .setStoragePath(storePath) .setWalPath(storePath + "/wal") .setWalArchivePath(storePath + "/archive") .setDefaultDataRegionConfiguration( new DataRegionConfiguration() .setPersistenceEnabled(true) .setMaxSize(2L * 1024 * 1024 * 1024) ) ); return cfg; }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String igniteInstanceName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(igniteInstanceName); if (atomicConfiguration != null) cfg.setAtomicConfiguration(atomicConfiguration); cfg.setCommunicationSpi(new TestRecordingCommunicationSpi()); cfg.setConnectorConfiguration(new ConnectorConfiguration()); DataStorageConfiguration memCfg = new DataStorageConfiguration() .setDefaultDataRegionConfiguration(new DataRegionConfiguration() .setMaxSize(50L * 1024 * 1024)); if (dataRegionConfiguration != null) memCfg.setDataRegionConfigurations(dataRegionConfiguration); cfg.setDataStorageConfiguration(memCfg); DataStorageConfiguration dsCfg = cfg.getDataStorageConfiguration(); dsCfg.setWalMode(WALMode.LOG_ONLY); dsCfg.getDefaultDataRegionConfiguration().setPersistenceEnabled(true); cfg.setConsistentId(igniteInstanceName); cfg.setClientMode(igniteInstanceName.startsWith("client")); return cfg; }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String igniteInstanceName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(igniteInstanceName); DataStorageConfiguration memCfg = new DataStorageConfiguration() .setDefaultDataRegionConfiguration( new DataRegionConfiguration() .setMaxSize(30 * 1024 * 1024) .setPersistenceEnabled(true)) .setWalMode(WALMode.LOG_ONLY); cfg.setDataStorageConfiguration(memCfg); return cfg; }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String gridName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(gridName); cfg.setConsistentId("ConsId" + (condId++)); ((TcpDiscoverySpi)cfg.getDiscoverySpi()).setIpFinder(primaryIpFinder); DataStorageConfiguration pCfg = new DataStorageConfiguration(); pCfg.setStoragePath(testName + "/db"); pCfg.setWalArchivePath(testName + "/db/wal/archive"); pCfg.setWalPath(testName + "/db/wal"); pCfg.setDefaultDataRegionConfiguration( new DataRegionConfiguration().setMaxSize(200L * 1024 * 1024).setPersistenceEnabled(true)); pCfg.setWalMode(WALMode.LOG_ONLY); pCfg.setPageSize(1024); pCfg.setConcurrencyLevel(64); cfg.setDataStorageConfiguration(pCfg); return cfg; }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String igniteInstanceName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(igniteInstanceName); cfg.setConsistentId(igniteInstanceName); DataStorageConfiguration dsCfg = new DataStorageConfiguration() .setDefaultDataRegionConfiguration( new DataRegionConfiguration().setMaxSize(100L * 1024 * 1024).setPersistenceEnabled(true)) .setWalMode(WALMode.LOG_ONLY) .setWalCompactionEnabled(false) .setWalSegmentSize(WAL_SEGMENT_SIZE) .setCheckpointFrequency(240 * 60 * 1000) .setConcurrencyLevel(Runtime.getRuntime().availableProcessors() * 4); if (ioFactory != null) dsCfg.setFileIOFactory(ioFactory); cfg.setDataStorageConfiguration(dsCfg); CacheConfiguration cacheCfg = new CacheConfiguration(CACHE_NAME) .setRebalanceMode(CacheRebalanceMode.NONE) .setAtomicityMode(CacheAtomicityMode.TRANSACTIONAL) .setWriteSynchronizationMode(CacheWriteSynchronizationMode.FULL_SYNC) .setAffinity(new RendezvousAffinityFunction(false, 1)); cfg.setCacheConfiguration(cacheCfg); return cfg; }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String gridName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(gridName); cfg.setClientMode(CLIENT_GRID_NAME.equals(gridName)); if (!cfg.isClientMode()) { String val = "node" + getTestIgniteInstanceIndex(gridName); cfg.setUserAttributes(Collections.singletonMap(TEST_ATTR, val)); cfg.setConsistentId(val); } DataStorageConfiguration memCfg = new DataStorageConfiguration() .setDataRegionConfigurations(new DataRegionConfiguration().setName(MEM).setInitialSize(10 * MB)) .setDefaultDataRegionConfiguration( new DataRegionConfiguration(). setMetricsEnabled(true). setMaxSize(50L * MB). setPersistenceEnabled(true). setName(DEFAULT_REGION)) .setWalMode(WALMode.LOG_ONLY) .setWalSegmentSize(16 * MB) .setPageSize(1024) .setMetricsEnabled(true); cfg.setDataStorageConfiguration(memCfg); cfg.setCacheConfiguration(cfgFactory.get()); return cfg; }
@Override protected IgniteConfiguration prepareIgniteConfiguration() { IgniteConfiguration cfg = super.prepareIgniteConfiguration(); cfg.setDataStorageConfiguration( new DataStorageConfiguration() .setWalSegmentSize(SEGMENT_SIZE) .setWalRecordIteratorBufferSize(SEGMENT_SIZE / 2) .setWalMode(WALMode.FSYNC) .setWalPath(workDir + WORK_SUB_DIR) .setWalArchivePath(workDir + ARCHIVE_SUB_DIR) .setFileIOFactory(new RandomAccessFileIOFactory()) ); cfg.setEventStorageSpi(new NoopEventStorageSpi()); return cfg; }
/** * Create common node configuration. * * @param idx Index. * @return Configuration. * @throws Exception If failed. */ @Override protected IgniteConfiguration commonConfiguration(int idx) throws Exception { IgniteConfiguration cfg = super.commonConfiguration(idx); DataRegionConfiguration dataRegionCfg = new DataRegionConfiguration().setName(DATA_REGION_NAME); cfg.setDataStorageConfiguration(new DataStorageConfiguration().setDataRegionConfigurations(dataRegionCfg)); return optimize(cfg); }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String igniteInstanceName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(igniteInstanceName); return cfg.setDataStorageConfiguration(new DataStorageConfiguration() .setDefaultDataRegionConfiguration(new DataRegionConfiguration() .setMaxSize(200 * 1024 * 1024) .setPersistenceEnabled(true))); }
/** * @return DB config. */ private DataStorageConfiguration createDbConfig() { DataStorageConfiguration storageCfg = new DataStorageConfiguration(); storageCfg.setCheckpointFrequency(300); storageCfg.setDefaultDataRegionConfiguration( new DataRegionConfiguration() .setPersistenceEnabled(true) .setMaxSize(DataStorageConfiguration.DFLT_DATA_REGION_INITIAL_SIZE) ); return storageCfg; }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String gridName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(gridName); cfg.setCacheConfiguration(new CacheConfiguration(TEST_CACHE) .setAtomicityMode(CacheAtomicityMode.TRANSACTIONAL)); DataStorageConfiguration memCfg = new DataStorageConfiguration() .setDefaultDataRegionConfiguration(new DataRegionConfiguration() .setMaxSize(2048L * 1024 * 1024) .setPersistenceEnabled(true)) .setWalMode(fsync ? WALMode.FSYNC : WALMode.BACKGROUND) .setWalBufferSize(1024 * 1024) .setWalSegmentSize(512 * 1024) .setFileIOFactory(new FailingFileIOFactory(failMtdNameRef)); cfg.setDataStorageConfiguration(memCfg); cfg.setFailureHandler(new TestFailureHandler(false)); return cfg; }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String gridName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(gridName); cfg.setDataStorageConfiguration(new DataStorageConfiguration() .setWalMode(WALMode.LOG_ONLY) .setWalFsyncDelayNanos(0) .setFileIOFactory(new AsyncFileIOFactory()) .setDefaultDataRegionConfiguration( new DataRegionConfiguration() .setPersistenceEnabled(true) .setInitialSize(10L * 1024L * 1024L) .setMaxSize(10L * 1024L * 1024L) )); cfg.setCacheConfiguration( new CacheConfiguration<>(DEFAULT_CACHE_NAME) .setAffinity(new RendezvousAffinityFunction(false, 1)) ); return cfg; }
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String igniteInstanceName) throws Exception { IgniteConfiguration cfg = super.getConfiguration(igniteInstanceName); cfg.setDataStorageConfiguration(new DataStorageConfiguration() .setDefaultDataRegionConfiguration( new DataRegionConfiguration().setName("mem0").setPersistenceEnabled(false)) .setDataRegionConfigurations( new DataRegionConfiguration().setName("disk").setPersistenceEnabled(true), new DataRegionConfiguration().setName("mem2").setPersistenceEnabled(false))); return cfg; }
cfg.setClientMode(true); else { DataStorageConfiguration dsCfg = new DataStorageConfiguration() .setConcurrencyLevel(Runtime.getRuntime().availableProcessors() * 4) .setWalMode(WALMode.LOG_ONLY) .setDefaultDataRegionConfiguration( new DataRegionConfiguration() .setPersistenceEnabled(true) dsCfg.setFileIOFactory(new BlockingCheckpointFileIOFactory());
/** {@inheritDoc} */ @Override protected IgniteConfiguration getConfiguration(String name) throws Exception { IgniteConfiguration cfg = super.getConfiguration(name); cfg.setDataStorageConfiguration(new DataStorageConfiguration() .setDefaultDataRegionConfiguration(new DataRegionConfiguration().setPersistenceEnabled(true)) .setWalMode(FSYNC) .setWalArchivePath(DFLT_WAL_PATH)); return cfg; }