Deep dive into Kernel

Hbase Scan example - scan table from "2012-05-09-09-35-192.168.0.0" to "2012-05-09-09-40-192.168.0.0" with row keys.- Filter row key which has string "192.168.210.10" source code package org.hadoop.dna.analyzer;import java.io.IOException; import org.apache.hadoop.conf.*;import org.apache.hadoop.fs.Path;import org.apache.hadoop.hbase.HBaseConfiguration;import org.apache.hadoop.hbase.client.Get;im..

HBase Get example Source Code package org.hadoop.dna.analyzer; import java.io.IOException; import org.apache.hadoop.conf.*;import org.apache.hadoop.fs.Path;import org.apache.hadoop.hbase.HBaseConfiguration;import org.apache.hadoop.hbase.client.Get;import org.apache.hadoop.hbase.client.HTable;import org.apache.hadoop.hbase.client.Result;import org.apache.hadoop.hbase.util.Bytes; public class Traf..

Fetch data from HTable - Create Get instance with Row Key "rowkey1"Get get = new Get(Bytes.toBytes("rowkey1")); - Specify column family ("sig:botnet")get.addColumn(Bytes.toBytes("sig"), Bytes.toBytes("botnet"));Result result = htable.get(get); - Get value of column family (sig:botnet ==> value)byte[] val = result.getValue(Bytes.toBytes("sig"), Bytes.toBytes("botnet"));System.out.println("Value:"..

Insert Data into HTable - Create Put instance with Row Key "rowkey1"Put put = new Put(Bytes.toBytes("rowkey1")); - Insert data with Colume Family with "sig" & "botnet", then the value as "sobic"put.add(Bytes.toBytes("sig"), Bytes.toBytes("botnet"), Bytes.toBytes("sobic")); - insert data into htablehtable.put(put); Source code package org.hadoop.dna; import java.io.IOException; import org.apache...

Now we will make HBase table in Eclipse. Step 1. Create Java Class file Step 2. fill information .Package: the package name for your code (any name is OK) .Name : Your Java Class name (any name is OK) .Check "public static void main...." Source Code package org.hadoop.dna; import java.io.IOException; import org.apache.hadoop.conf.*;import org.apache.hadoop.fs.Path;import org.apache.hadoop.hbase...

hadoop fs -cat [dir]/* | hadoop fs -put - [destination file]

하둡 개발시 디버깅은 syslog 를 이용해서 가능하다 import org.apache.commons.logging.LogFactory; import org.apache.commons.logging.Log; // 메인 클래스에 LOG라는 변수를 선언함 public class FlowMR { private static final Log LOG = LogFactory.getLog(FlowMR.class); // 실제 사용은 public void reduce(Text key, Iterable values, Context context ) throws IOException, InterruptedException { ArrayList list1 = new ArrayList(); //HashMap myMap = n..