Posts tagged saas

Papertrail can now filter log messages on behalf of your apps and systems.

Constantly logging a noisy system error that you’re well aware of? Don’t care about requests from monitoring probes? Give us a regular expression and we’ll ignore them. No need to touch your app or system config.

Keep reading or dive right in the docs.

Why is this important?

Usefulness is in the eye of the beholder. It’s not our job to tell you what log messages might be useful, and we’d prefer that it isn’t left to your application or system’s default configuration, either. The logs that the author chose to generate may not have any relationship to the ones you care about.

Our job is to expose intelligently-chosen control and configurability. More succinctly: the knobs that matter. This is one of them.

Logging configs are harder to change than they could be, especially with multiple senders and deployment environments. Papertrail’s log filtering transfers that control from the daemon or framework author to you.

That’s true for managed services too, where a hosting provider may not be able to modify their logging policies to suit a single customer.

Also, Papertrail is in a unique position to provide infrastructure-wide logging control. In addition to message content, Papertrail can filter by sender, program, or log destination, which means there’s a single place to silence almost any unnecessary logs.

We hope this saves time which might otherwise be spent fighting with app configs.

Am I charged for filtered messages?

No. Log filtering is included with all Papertrail accounts and filtered messages don’t consume log data transfer.

Let’s see it in action

A standard Ruby on Rails app generates these messages for every page fragment (“partial”) used in a page:

Rendered layouts/_head.html.erb

Although we have easy ways to make Rails less verbose, assume I’m mostly happy with the stock logging except these messages. Knowing the list of page elements that were rendered usually serves no purpose in production, so they’re basically noise. And changing the log output either means omitting other messages (by decreasing verbosity) or monkey-patching Rails.

So, let’s have Papertrail ignore them. Use the filter:

Rendered 

In your log destination configuration (Account), it looks like this:

Users of Papertrail via hosting services may see a slightly different presentation for clarity.

Next, let’s just ignore these messages from senders that begin with “www” (like www1 and www2), not all senders. Also, we don’t care about static asset requests (like images and CSS files), either, so let’s also ignore messages from those senders that contain “/assets”. Use the filter:

www\d+ \W: (Rendered|\/assets)

See it in Rubular. The filter is a regular expression. This regex matches any sender name with “www” followed by one or more digits, then any app name from those senders, then either of the messages we want to filter.

Use it

Use Papertrail’s log filtering to customize where an app should be verbose and where it should be quiet. No need to be limited by the sending service’s default settings or the implementor’s preferences. Just decide what you don’t want and create a regular expression to match it.

Head over to Log Filtering and read more, then configure it in Account settings.

We formally announced public availability of Papertrail hosted log management yesterday. This is as formal as we get!

Read the announcement below (or on Business Wire).

Cloud-Based Logging Service Papertrail Launches

Hosted log management service helps engineers detect, resolve, and avoid infrastructure problems

SEATTLE—(BUSINESS WIRE)—Cloud-based log management service Papertrail™ announced public availability today. Papertrail delivers effortless log aggregation and management as a hosted service (SaaS).

In 30 seconds, an engineer or startup entrepreneur can obtain a searchable, scalable, always-on repository for their server and application log messages, over the Internet. With a simple one-line change, logs are sent to Papertrail as they happen.

Bringing all log messages together is the gateway to powerful operations visibility, monitoring, and analysis with Papertrail. For example:

• systems administrators can watch infrastructure events in realtime — from the Web, command-line, or REST API.
• developers diagnosing app problems can search for anything they know (like an IP address, error message, or customer name), or seek right to a specific time or server.
• support staff can view events from only the product that they support, without access to the underlying systems.
• architects can setup alerts to notify monitoring systems about important events (web hooks), and analyze months of logs in Hadoop to identify trends.

“Engineers often discover Papertrail as the easiest way to aggregate server log files, then they try it and realize that log collection is just the beginning,” said Troy Davis, co-founder and CEO of Papertrail’s operating company, Seven Scale. “Seeing operating system logs, app server requests, database queries, and router logs in one live interface is incredibly useful.”

A single Web request might generate a firewall log message, a Redis lookup, a dozen MySQL queries, a Ruby on Rails request log, a handful of static file logs from Apache, and syslog from a background task. Because Papertrail works with all common log methods, engineers can see these related events together as an end-to-end operational narrative.

Pre-launch customers already use Papertrail to manage many terabytes every month. It seamlessly scales with each customer’s needs, whether a few messages per hour or thousands per second. Systems and apps can reside on physical servers, hosting services like Amazon Elastic Compute Cloud (EC2), and app clouds like Heroku.

“DevOps engineers want productivity. It’s not just about more data or more features, but the right info at the right time,” Davis said. “Papertrail provides that, and in less than a minute.”

Demonstrations will be available at the O’Reilly Velocity Web Performance & Operations Conference.

Seven Scale operates the Papertrail hosted log management service, which brings smiles to the faces of systems engineers, developers, and entrepreneurs.

Everyone deserves great logging. Sign up and log to the cloud™ at http://papertrailapp.com/