Pig latin Regex_extract_All

Question

I am new to pig .I need to extract catalina log and the format is like below line.I need my program to use a pattern which can read next line which starts from INFO,but it does not do that.

A = LOAD 'catalina. USING TextLoader AS (line:chararray);  
B = FOREACH A GENERATE FLATTEN(REGEX_EXTRACT_ALL(line,'^([a-zA-z]{3}\\s[0-9]{1,2},\\s[0-9]{4}\\s[0-9]{1,2}:[0-9]{2}:[0-9]{2}\\s[A-Z]{2})(.*)INFO:(.*)$'))

STORE B IN 'output' ;

Input:

Nov 3, 2016 11:00:06 AM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 470 ms.

Brian R Armstrong Brian R Armstrong · Accepted Answer · 2016-11-24T14:50:18

Your problem is the two (.) captures immediately before and after INFO. You want this instead:

^([a-zA-z]{3}\s[0-9]{1,2},\s[0-9]{4}\s[0-9]{1,2}:[0-9]{2}:[0-9]{2}\s[A-Z]{2})\s([\w\.]+)\sINFO:\s(.*)$

Pig latin Regex_extract_All

1 Answers