ITeye博客

ilnba的博客

ilnba · 共 92 篇文章

flumeng hbase jmx integration

flumeng agent collect log events to flumeng collector flumeng collector sends data into hbase flumeng property file is monitored and controlled by JMX Other MBean Example existing in Flume ObjectName org.apache.flume.channel:type=fc ClassName org.apache.flume.instrumentation.ChannelCounter ObjectNa…

2013-04-12T15:14:22Z · 开源软件 · 评论(0)

Hbase MapReduce Integration

Delete Hbase rows example $hadoop jar ./sponge-hserver.jar com.citi.sponge.mapreduce.MRDeleteRows -Dtable="elf_log" -DstartKey="10000:1365663164575:88888:testhome" -DstopKey="10000:1365663164575:88890:testhome" -Dquorum="vm-15c2-3bbf.nam.nsroot.net,vm-ab1f-dd21.nam.nsroot.net,vm-cb03-2277.nam.nsroo…

2013-04-11T16:16:03Z · 编程语言 · 评论(0)

Spring By example -- aop

Spring AOP essentials 1. ProxyFactoryBean is used for declaring AOP 2. ProxyFactory is for programming AOP 3. AspectJFactoryBean is for AspectJ integration 4. For interface, JDK proxy is used 5. For class, CGLib is used 6. Ref InvocationHandler Defining AOP terminology ADVICE In AOP terms, the job …

2013-03-26T14:09:16Z · 开源软件 · 评论(0)

Spring By example -- core

Spring IOC 容器的两种实现 BeanFactory 和ApplicationContext DefaultListableBeanFactory作为一个功能完备的默认的IOC容器 ApplicationContext 除了基本的功能外,还支持不同的信息源,访问资源,支持应用事件,提供附加服务;比基本的BeanFactory提供了更高级的形态 IOC容器的初始化过程 1. BeanDefinitioin的Resource定位 对于不同的ApplicationContext,会对应不同的Rsource,例如ClassPathResource,ServletContextResource…

2013-03-25T15:53:26Z · 开源软件 · 评论(0)

flume ng performance tuning

Transactions are critical concept for FlumeNG. Sources produce events into Channel based on transaction batch size. Sinks consume events from Channel based on transaction batch size. It means the batch size is the key for performance tuning. For agent. ExecSource is used to collect events and the d…

2013-03-25T14:22:04Z · 开源软件 · 评论(0)

flume ng arc and configuration

Please ref flume user guide first http://flume.apache.org/FlumeUserGuide.html And the Cloudera flume blogs http://blog.cloudera.com/blog/category/flume/ How to define JAVA_HOME, java options and add our customized lib into flume-ng. All these information will be defined in FLUME_CONFI_DIR/flume-env…

2013-03-22T16:11:09Z · 开源软件 · 评论(0)

Hadoop best practise

http://www.infoq.com/cn/articles/hadoop-ten-best-practice http://www.infoq.com/cn/articles/MapReduce-Best-Practice-1

2013-03-21T15:56:12Z · 开源软件 · 评论(0)

Gitub change username

http://alvinalexander.com/git/git-show-change-username-email-address

2013-03-20T21:56:19Z · 研发管理 · 评论(0)

Log Management

http://kibana.org/ http://graylog2.org/ http://www.elasticsearch.org/ http://logstash.net/ http://lucene.apache.org/core/3_6_1/queryparsersyntax.html http://twitter.github.com/bootstrap/

2013-01-24T11:02:11Z · 行业应用 · 评论(0)

好博客

http://www.williamlong.info/archives/919.html http://qbox.io/ http://www.searchtb.com/ http://blogread.cn/it/ http://www.cnblogs.com/heaad/ http://blog.javachen.com/ Cloudera Search http://www.cloudera.com/content/cloudera/en/resources/library/recordedwebinar/big-data-search-bigger-insights.html ht…

2013-01-17T21:07:14Z · 非技术 · 评论(0)

ElasticSearch (8) shard allocation

http://www.elasticsearch.org/guide/reference/index-modules/allocation.html #disk usage aware allocator plugin https://github.com/sonian/elasticsearch-equilibrium https://groups.google.com/forum/?fromgroups=#!topic/elasticsearch/PT5BZ9jUeJQ

2013-01-03T10:41:50Z · 企业架构 · 评论(0)

ElasticSearch (6) cluster setting

configuration file : $ES_HOME/conf/elasticsearch.yml cluster.name : PPPPPP path.conf: /opt/PPPPPP/elasticsearch/conf index.number_of_replicas : 0 index.number_of_shards : 5 index.analysis.analyzer.default.pattern : "[^\\w]+" index.analysis.analyzer.default.type : pattern index.store.compress.stored…

2012-12-26T13:54:24Z · 企业架构 · 评论(0)

ElasticSearch (7) default index mapping

default mapping file : $ES_HOME/conf/default-mapping.json { "_default_" : { "_ttl" : { "enabled" : true, "default" : 7776000000 }, "_source" : { "enabled" : false }, "properties" : { "env" : { "type" : "string", "index" : "not_analyzed" }, "eventbody" : { "type" : "string" }, "hostname" : { "type" …

2012-12-26T13:54:11Z · 企业架构 · 评论(0)

VisualVM

VisualVM home http://visualvm.java.net/ How to start jstatd 1. go to $JAVA_HOME/bin vi jstatd.all.policy 2. add below content grant codebase "file:${java.home}/../lib/tools.jar" { permission java.security.AllPermission; }; 3. execute ./jstatd -J-Djava.security.policy=jstatd.all.policy &

2012-12-26T13:39:58Z · 研发管理 · 评论(0)

ElasticSearch (5) Excellent Blog or Example

Data Visualization on ES http://www.elasticsearch.org/blog/2011/05/13/data-visualization-with-elasticsearch-and-protovis.html Search Engine Indexing http://en.wikipedia.org/wiki/Index_(search_engine)#Inverted_indices Faceted Search http://en.wikipedia.org/wiki/Faceted_search Information Filtering a…

2012-12-26T10:41:16Z · 互联网 · 评论(0)