【问题标题】:How to multiply list of tensors by single tensor on TensorFlow?如何将张量列表乘以 TensorFlow 上的单个张量?
【发布时间】:2017-02-28 23:06:25
【问题描述】:

我正在实现一个 RNN,这与我发现的示例相反,这些示例仅最小化最后一步的输出成本

x = tf.placeholder ("float", [features_dimension, None, n_timesteps])
y = tf.placeholder ("float", [labels_dimension, None, n_timesteps])

# Define weights
weights = {'out': tf.Variable (tf.random_normal ([N_HIDDEN, labels_dimension]))}
biases = {'out': tf.Variable (tf.random_normal ([labels_dimension]))}

def RNN (x, weights, biases):
    # Prepare data shape to match `rnn` function requirements
    # Current data input shape: (features_dimension, BATCH_SIZE, n_timesteps)
    # Required shape: `n_timesteps` tensors list of shape (BATCH_SIZE, features_dimension)
    # We make a division of the data to split it in individual vectors that
    # will be fed for each timestep

    # Permuting features_dimension and n_timesteps
    # Shape will be (n_timesteps, BATCH_SIZE, features_dimension)
    x = tf.transpose (x, [2, 1, 0])
    # Reshaping to (BATCH_SIZE*n_timesteps, features_dimension) (we are removing the depth dimension with this)
    x = tf.reshape(x, [BATCH_SIZE*n_timesteps, features_dimension])
    # Split the previous 2D tensor to get a list of `n_timesteps` tensors of
    # shape (batch_size, features_dimension).
    x = tf.split (x, n_timesteps, 0)

    # Define a lstm cell with tensorflow
    lstm_cell = rnn.BasicLSTMCell (N_HIDDEN, forget_bias=1.0)
    # Get lstm cell output
    outputs, states = rnn.static_rnn (lstm_cell, x, dtype=tf.float32)
    # Linear activation; outputs contains the array of outputs for all the
    # timesteps
    pred = tf.matmul (outputs, weights['out']) + biases['out']

但是,outputs 对象是带有n_timesteps 元素的Tensor 列表,因此pred = tf.matmul (outputs, weights['out']) + biases['out'] 会引发错误

ValueError: Shape 必须是 2 级,但 'MatMul' 是 3 级(操作: 'MatMul') 输入形状:[100,128,16], [16,1]。

。我该如何做这个乘法?

【问题讨论】:

    标签: python tensorflow


    【解决方案1】:

    解决方案是将tf.stack张量列表变成一个3d张量,然后使用tf.map_fn对每个2d张量沿维度0进行乘法运算:

        # Transform the list into a 3D tensor with dimensions (n_timesteps, batch_size, N_HIDDEN)
        outputs = tf.stack(outputs)
    
        def pred_fn(current_output):
            return tf.matmul(current_output, weights['out']) + biases['out']
        # Use tf.map_fn to apply pred_fn to each tensor in outputs, along dimension 0 (timestep dimension)
        pred = tf.map_fn(pred_fn, outputs)
    

    【讨论】:

      猜你喜欢
      • 2018-11-28
      • 1970-01-01
      • 1970-01-01
      • 2020-08-26
      • 2016-10-15
      • 2017-08-21
      • 2018-08-02
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多