node.js 按域计算带宽使用情况

Question

如何使用 node.js 作为 Web 服务器监控每个域的带宽使用情况？

有人知道我没有遇到过的 API 调用吗？

或者其他人在您按带宽收费的多租户环境中使用的模块或其他方法？

更新：

有谁知道可以放置在任何 Web 服务器（node.js、apache 等）前面的轻量级代理/服务器，可以通过检查域来记录这些带宽统计信息？

Answer 1

在不修改 node.js 核心的情况下，最好的选择似乎是使用 bytesRead 和 bytesWritten 变量在套接字级别跟踪它。

这实际上比仅测量 http 请求/响应字符串的大小更准确，因为某些其他带宽跟踪器会计算传输的数据。

您有 2 个选项：1) 记录每个请求的字节数或 2) 记录 TCP 连接关闭时的字节数。

在请求级别登录将提供可能有用的实时数据。但是，这可能会减慢速度，具体取决于您实现日志记录的方式。最好将其保存在内存中并每隔一段时间将其转储到磁盘/数据库中。

在请求级别记录：

var http = require('http');
var server = http.createServer(function (req, res) {
  // setup a counter for bytes already logged
  req.connection.bytesLogged = (req.connection.bytesLogged || 0);

  // output the bytes read by the socket
  console.log('Socket [' + req.connection.remoteAddress + '] [' + req.headers.host + '] - Bytes Read: ' + req.connection.bytesRead);

  // calculate the bytes of the request (includes headers and other tcp overhead - more realistic)
  req.bytes = req.connection.bytesRead - req.connection.bytesLogged;
  // output the bytes size of the request (note this is calculated after the TCP packets have been collected from the network and parsed by the HTTP parser
  console.log('Request [' + req.connection.remoteAddress + '] [' + req.headers.host + '] - Bytes: ' + req.bytes);

  // log the bytes to a memory array, DB or disk (implementation not shown)
  // [code here]

  // add the request bytes to the counter
  req.connection.bytesLogged = req.connection.bytesLogged + req.bytes;

  // normal http server processing like return document or file
  res.writeHead(200, {'Content-Type': 'text/plain'});
  res.end('ok');
}).listen(1337, '127.0.0.1');
console.log('Server running at http://127.0.1.1:1337/');

在套接字级别记录：

var http = require('http');
var server = http.createServer(function (req, res) {

  // create some variables for data we want to log
  //
  // due to the way node.js works the remoteAddress and remotePort will not
  // be available in the connection close event
  // we also need to store the domain/host from the http header because the http
  // request also won't exist when the connection close event runs
  var remoteAddress = req.connection.remoteAddress;
  var remotePort = req.connection.remotePort;
  var host = req.headers.host;
  var connection = req.connection;

  // output bytes read by socket on each request
  console.log('HTTP Request [' + remoteAddress + ':' + remotePort + '] [' + host + '] - connection Bytes Read: ' + connection.bytesRead);

  // setup handle for connection close event
  //
  // to avoid the handle being added multiple times we add the handle onto
  // the connection object which will persist between http requests
  //
  // we store the handler so we can check whether it has already been added
  // to the connection listeners array - a less robust alternative would be to
  // add a flag like connection.closeHandleAdded = true
  connection.handle = connection.handle || {};
  if (!connection.handle.onconnectionClose) {
    connection.handle.onconnectionClose = function() {
      onconnectionClose(remoteAddress, remotePort, host, connection.bytesRead);
    }
  }

  // check whether the close handle has already been added to the connection
  // if not add it
  if(connection.listeners('close').indexOf(connection.handle.onconnectionClose) == -1)
  {
    // attach handler to connection close event
    connection.on('close', connection.handle.onconnectionClose);
    // set connection idle timeout to 5 secs for testing purposes (default is 2min)
    connection._idleTimeout = 5000;
  }

  // process http request as required
  res.writeHead(200, {'Content-Type': 'text/plain'});
  res.end('ok');

}).listen(1337, '127.0.0.1');
console.log('Server running at http://127.0.1.1:1337/');

function onconnectionClose (remoteAddress, remotePort, host, bytesRead) {
   console.log('connection Closed [' + remoteAddress + ':' + remotePort + '] [' + host + '] - connection Bytes Read: ' + bytesRead);
}

Answer 2

你应该看看Http Trace。

它是一个 node.js 模块，用于捕获、解码和分析 HTTP 和 WebSocket 流量。 它可以找到每个请求的大小和域，因此通过一些调整，您应该能够在这里完成您想要完成的工作。

它在我的带有节点 v0.6.15 的 Ubuntu 服务器上运行良好，我所要做的就是“apt-get install libpcap0.8-dev”。

Answer 3

尝试使用此模块测量 HTTP 响应/请求：https://github.com/hex7c0/transfer-rate

数据通过套接字在客户端和服务器之间发送。每个 HTTP 响应/请求都有自己的套接字。模块在套接字中获取发送字节（socket.bytesWritten 用于响应，socket.bytesRead 用于请求）。通过命令（process.hrtime(start)）计算发送数据的时间。然后，我们将结果除以得到实际的传输速率。