【问题标题】:How to do a Mongo aggregation query in Spring Data?如何在 Spring Data 中进行 Mongo 聚合查询?
【发布时间】:2020-04-29 00:53:57
【问题描述】:

这是我第一次在 Java 中使用 Mongo,我在使用这个聚合查询时遇到了一些问题。我可以在 Mongo for Spring 中使用 @Query 注释在我的 Repository 接口中进行一些简单的查询,该接口扩展了 MongoRepository<T, ID>。在 Spring-Data 中进行长聚合时,了解采用哪种方法会很有帮助。

db.post.aggregate([
    {
      $match: {}
    },
    {
      $lookup: {
        from: "users",
        localField: "postedBy",
        foreignField: "_id",
        as: "user"
      }
    },
    {
      $group: {
        _id: {
          username: "$user.name",
          title: "$title",
          description: "$description",
          upvotes: { $size: "$upvotesBy" },
          upvotesBy: "$upvotesBy",
          isUpvoted: { $in: [req.query.userId, "$upvotesBy"] },
          isPinned: {
            $cond: {
              if: { $gte: [{ $size: "$upvotesBy" }, 3] },
              then: true,
              else: false
            }
          },
          file: "$file",
          createdAt: {
            $dateToString: {
              format: "%H:%M %d-%m-%Y",
              timezone: "+01",
              date: "$createdAt"
            }
          },
          id: "$_id"
        }
      }
    },
    { $sort: { "_id.isPinned": -1, "_id.createdAt": -1 } }
])

【问题讨论】:

标签: java spring mongodb spring-data spring-data-mongodb


【解决方案1】:

虽然这是旧线程,但我希望找到此线程的人现在可以安全地在 MongoRepository 中进行多阶段/管道聚合(不太确定它的名称)。 因为我也在努力寻找 mongo 存储库中聚合的线索和示例没有 mongo 模板

但是现在,我可以按照 here 中所说的 spring 文档进行聚合管道

我的聚合在 mongoshell 中是这样的:

db.getCollection('SalesPo').aggregate([
    {$project: {
        month: {$month: '$poDate'},
        year: {$year: '$poDate'},
        amount: 1,
        poDate: 1
     }},
      {$match: {$and : [{year:2020} , {month:7}] 
     }}
      ,
      {$group: { 
          '_id': {
            month: {$month: '$poDate'},
            year: {$year: '$poDate'} 
          },
          totalPrice: {$sum: {$toDecimal:'$amount'}},
          }
      },
    {$project: {
        _id: 0,
        totalPrice: {$toString: '$totalPrice'}
     }}
 ])

当我将它转换为 MongoRepository 中的 @Aggregation 注释时,如下所示(我正在删除撇号并替换为方法参数):

@Repository
public interface SalesPoRepository extends MongoRepository<SalesPo, String> {

@Aggregation(pipeline = {"{$project: {\n" +
        "        month: {$month: $poDate},\n" +
        "        year: {$year: $poDate},\n" +
        "        amount: 1,\n" +
        "        poDate: 1\n" +
        "     }}"
        ,"{$match: {$and : [{year:?0} , {month:?1}] \n" +
        "     }}"
        ,"{$group: { \n" +
        "          '_id': {\n" +
        "            month: {$month: $poDate},\n" +
        "            year: {$year: $poDate} \n" +
        "          },\n" +
        "          totalPrice: {$sum: {$toDecimal:$amount}},\n" +
        "          }\n" +
        "      }"
    ,"{$project: {\n" +
        "        _id: 0,\n" +
        "        totalPrice: {$toString: $totalPrice}\n" +
        "     }}"})
    AggregationResults<SumPrice> sumPriceThisYearMonth(Integer year, Integer month);

我的文档如下所示:

@Document(collection = "SalesPo")
@Data
public class SalesPo {
  @Id
  private String id;
  @JsonSerialize(using = LocalDateSerializer.class)
  private LocalDate poDate;
  private BigDecimal amount;
}

SumPrice 类用于保存预测:

@Data
public class SumPrice {
  private BigDecimal totalPrice;
}

我希望这个答案可以帮助任何人尝试在不使用 mongotemplate 的情况下在 mongorepository 中进行聚合

【讨论】:

  • 如何处理空参数?
  • @saran3h sum mongodb 开箱即用将空值(或非数值)处理为零。见docs.mongodb.com/manual/reference/operator/aggregation/sum
  • 嗨,谢谢你的回答,但我有一些困惑:1.有没有更好的方法在@Aggregation 中编写查询 json?使用换行模式和引号解析查询字符串很烦人标记。
  • 2.是否可以不定义一个类来检索聚合结果?因为结果可能包含许多参考文档。我必须全部定义它们才能做到这一点。例如,我已经定义了一些映射到集合的实体。它们通过使用 objectids 数组相互引用。我进行聚合以返回整个匹配的完整文档,它将 objectids 替换为真实文档。为了检索最终文档,我重新定义了整个实体树除了将 objectid 数组替换为嵌套实体数组外没有任何变化。有没有更好的方法来解决这个问题?
  • 更新:对于问题 2,我使用 JSONObject ,Object 或 BasicDBObject 来检索聚合结果。像这样:AggregationResults&lt;JSONObject&gt; result = someRepository.doAggregate(id)
【解决方案2】:

您可以实现 AggregationOperation 并编写自定义聚合操作查询,然后使用 MongoTemplate 执行您在 mongo shell 中执行的任何 mongo shell 查询,如下所示:

自定义聚合操作

import org.springframework.data.mongodb.core.aggregation.AggregationOperation;
import org.springframework.data.mongodb.core.aggregation.AggregationOperationContext;

public class CustomAggregationOperation implements AggregationOperation {

  private String jsonOperation;

  public CustomAggregationOperation(String jsonOperation) {
    this.jsonOperation = jsonOperation;
  }

  @Override
  public org.bson.Document toDocument(AggregationOperationContext aggregationOperationContext) {
    return aggregationOperationContext.getMappedObject(org.bson.Document.parse(jsonOperation));
  }
}

任何 Mongo Shell 聚合查询执行器

import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.data.mongodb.core.MongoTemplate;
import org.springframework.data.mongodb.core.aggregation.Aggregation;
import org.springframework.data.mongodb.core.aggregation.AggregationOperation;
import org.springframework.data.mongodb.core.aggregation.AggregationResults;
import org.springframework.data.mongodb.core.aggregation.TypedAggregation;
import org.springframework.stereotype.Service;
import sample.data.mongo.models.Course;

@Service
public class LookupAggregation {

  @Autowired
  MongoTemplate mongoTemplate;

  public void LookupAggregationExample() {

    AggregationOperation unwind = Aggregation.unwind("studentIds");

    String query1 = "{$lookup: {from: 'student', let: { stuId: { $toObjectId: '$studentIds' } },"
        + "pipeline: [{$match: {$expr: { $eq: [ '$_id', '$$stuId' ] },},}, "
        + "{$project: {isSendTemplate: 1,openId: 1,stu_name: '$name',stu_id: '$_id',},},], "
        + "as: 'student',}, }";

    TypedAggregation<Course> aggregation = Aggregation.newAggregation(
        Course.class,
        unwind,
        new CustomAggregationOperation(query1)
    );

    AggregationResults<Course> results =
        mongoTemplate.aggregate(aggregation, Course.class);
    System.out.println(results.getMappedResults());
  }
}

有关更多详细信息,请查看Github repository 类:CustomAggregationOperationLookupAggregation

其他方法也使用 MongoTemplate

#1.为模型Post的自定义代码定义一个接口:

interface CustomPostRepository {
     List<Post> yourCustomMethod();
}

#2.为这个类添加实现并遵循命名约定以确保我们可以找到这个类。

class CustomPostRepositoryImpl implements CustomPostRepository {

    @Autowired
    private MongoOperations mongoOperations;

    public List<Post> yourCustomMethod() {

      // custom match queries here
      MatchOperation match = null;
      // Group by , Lookup others stuff goes here
      // For details: https://docs.spring.io/spring-data/mongodb/docs/current/api/org/springframework/data/mongodb/core/aggregation/Aggregation.html

      Aggregation aggregate = Aggregation.newAggregation(match);

      AggregationResults<Post> orderAggregate = mongoOperations.aggregate(aggregate,
                      Post.class, Post.class);
      return orderAggregate.getMappedResults();

    }
}

#3.现在让您的基础存储库接口扩展自定义接口,基础架构将自动使用您的自定义实现:

interface PostRepository extends CrudRepository<Post, Long>, CustomPostRepository {

}

【讨论】:

    猜你喜欢
    • 2019-10-14
    • 2017-05-02
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2023-02-11
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多