status {rmr2}R Documentation

Set the status and define and increment counters for a Hadoop job

Description

These are Hadoop features used to monitor and debug jobs. Should be used with a grain of salt as far as their scalability.

Usage

status(value)
increment.counter(group, counter, increment = 1)

Arguments

value

The new value for the status of the job

group

The group for the counter

counter

The name for the counter

increment

By how much to increment the counter

Details

status sets the status for the current job. increment.counter increments the counter named counter in group group by increment. If the counter doesn't exist yet it is initialized to 0. Both calls work only within the map or reduce functions and under local backend just write some messages to stderr. Unfortunately there is no API to query the value of either status or counters at this time, but you can examine them via the jobtracker web interface.

Value

NULL for both.

Examples

mapreduce(to.dfs(1:1000), map = function(k,v){status("mapping"); increment.counter("Calls", "Map", 1)})

[Package rmr2 version 3.3.1 Index]