ilnba的博客
ilnba · 共 92 篇文章
flumeng hbase jmx integration
flumeng agent collect log events to flumeng collector flumeng collector sends data into hbase flumeng property file is monitored and controlled by JMX Other MBean Example existing in Flume ObjectName org.apache.flume.channel:type=fc ClassName org.apache.flume.instrumentation.ChannelCounter ObjectNa…
2013-04-12T15:14:22Z · 开源软件 · 评论(0)
Hbase MapReduce Integration
Delete Hbase rows example $hadoop jar ./sponge-hserver.jar com.citi.sponge.mapreduce.MRDeleteRows -Dtable="elf_log" -DstartKey="10000:1365663164575:88888:testhome" -DstopKey="10000:1365663164575:88890:testhome" -Dquorum="vm-15c2-3bbf.nam.nsroot.net,vm-ab1f-dd21.nam.nsroot.net,vm-cb03-2277.nam.nsroo…
2013-04-11T16:16:03Z · 编程语言 · 评论(0)
Spring By example -- aop
Spring AOP essentials 1. ProxyFactoryBean is used for declaring AOP 2. ProxyFactory is for programming AOP 3. AspectJFactoryBean is for AspectJ integration 4. For interface, JDK proxy is used 5. For class, CGLib is used 6. Ref InvocationHandler Defining AOP terminology ADVICE In AOP terms, the job …
2013-03-26T14:09:16Z · 开源软件 · 评论(0)
Spring By example -- core
Spring IOC 容器的两种实现 BeanFactory 和ApplicationContext DefaultListableBeanFactory作为一个功能完备的默认的IOC容器 ApplicationContext 除了基本的功能外,还支持不同的信息源,访问资源,支持应用事件,提供附加服务;比基本的BeanFactory提供了更高级的形态 IOC容器的初始化过程 1. BeanDefinitioin的Resource定位 对于不同的ApplicationContext,会对应不同的Rsource,例如ClassPathResource,ServletContextResource…
2013-03-25T15:53:26Z · 开源软件 · 评论(0)
flume ng performance tuning
Transactions are critical concept for FlumeNG. Sources produce events into Channel based on transaction batch size. Sinks consume events from Channel based on transaction batch size. It means the batch size is the key for performance tuning. For agent. ExecSource is used to collect events and the d…
2013-03-25T14:22:04Z · 开源软件 · 评论(0)
flume ng arc and configuration
Please ref flume user guide first http://flume.apache.org/FlumeUserGuide.html And the Cloudera flume blogs http://blog.cloudera.com/blog/category/flume/ How to define JAVA_HOME, java options and add our customized lib into flume-ng. All these information will be defined in FLUME_CONFI_DIR/flume-env…
2013-03-22T16:11:09Z · 开源软件 · 评论(0)
Hadoop best practise
http://www.infoq.com/cn/articles/hadoop-ten-best-practice http://www.infoq.com/cn/articles/MapReduce-Best-Practice-1
2013-03-21T15:56:12Z · 开源软件 · 评论(0)
Gitub change username
http://alvinalexander.com/git/git-show-change-username-email-address
2013-03-20T21:56:19Z · 研发管理 · 评论(0)
Log Management
http://kibana.org/ http://graylog2.org/ http://www.elasticsearch.org/ http://logstash.net/ http://lucene.apache.org/core/3_6_1/queryparsersyntax.html http://twitter.github.com/bootstrap/
2013-01-24T11:02:11Z · 行业应用 · 评论(0)
好博客
http://www.williamlong.info/archives/919.html http://qbox.io/ http://www.searchtb.com/ http://blogread.cn/it/ http://www.cnblogs.com/heaad/ http://blog.javachen.com/ Cloudera Search http://www.cloudera.com/content/cloudera/en/resources/library/recordedwebinar/big-data-search-bigger-insights.html ht…
2013-01-17T21:07:14Z · 非技术 · 评论(0)
ElasticSearch (8) shard allocation
http://www.elasticsearch.org/guide/reference/index-modules/allocation.html #disk usage aware allocator plugin https://github.com/sonian/elasticsearch-equilibrium https://groups.google.com/forum/?fromgroups=#!topic/elasticsearch/PT5BZ9jUeJQ
2013-01-03T10:41:50Z · 企业架构 · 评论(0)
ElasticSearch (6) cluster setting
configuration file : $ES_HOME/conf/elasticsearch.yml cluster.name : PPPPPP path.conf: /opt/PPPPPP/elasticsearch/conf index.number_of_replicas : 0 index.number_of_shards : 5 index.analysis.analyzer.default.pattern : "[^\\w]+" index.analysis.analyzer.default.type : pattern index.store.compress.stored…
2012-12-26T13:54:24Z · 企业架构 · 评论(0)
ElasticSearch (7) default index mapping
default mapping file : $ES_HOME/conf/default-mapping.json { "_default_" : { "_ttl" : { "enabled" : true, "default" : 7776000000 }, "_source" : { "enabled" : false }, "properties" : { "env" : { "type" : "string", "index" : "not_analyzed" }, "eventbody" : { "type" : "string" }, "hostname" : { "type" …
2012-12-26T13:54:11Z · 企业架构 · 评论(0)
VisualVM
VisualVM home http://visualvm.java.net/ How to start jstatd 1. go to $JAVA_HOME/bin vi jstatd.all.policy 2. add below content grant codebase "file:${java.home}/../lib/tools.jar" { permission java.security.AllPermission; }; 3. execute ./jstatd -J-Djava.security.policy=jstatd.all.policy &
2012-12-26T13:39:58Z · 研发管理 · 评论(0)
ElasticSearch (5) Excellent Blog or Example
Data Visualization on ES http://www.elasticsearch.org/blog/2011/05/13/data-visualization-with-elasticsearch-and-protovis.html Search Engine Indexing http://en.wikipedia.org/wiki/Index_(search_engine)#Inverted_indices Faceted Search http://en.wikipedia.org/wiki/Faceted_search Information Filtering a…
2012-12-26T10:41:16Z · 互联网 · 评论(0)