mongo批量更新的几种方法

发布时间 2023-08-26 14:23:34作者: 余生请多指教ANT
50w数据做测试

看一下mongo支持批量更新的几种PAI

 

1.0 public UpdateResult updateMulti(Query query, UpdateDefinition update, Class<?> entityClass)



2.0public UpdateResult updateMulti(Query query, UpdateDefinition update, String collectionName)



3.0public UpdateResult updateMulti(Query query, UpdateDefinition update, Class<?> entityClass, String collectionName)

4.0

 

 

给字段phone加上了唯一索引

/**
* 电话
*/
@Indexed(unique = true)
private String phone;

 

具体写法一:
1.查询集合内所有的数据
 Query query0 = new Query();
        query0.fields().include("phone");
        long l0 = System.currentTimeMillis();
        List<User> users1 = mongoTemplate.find(query0, User.class, "animals");
        List<String> collect = users1.stream().map(User::getPhone).collect(Collectors.toList());
        long l1 = System.currentTimeMillis();
        System.out.println(">>>>>>>>>>>:"+(l1-l0));
2.更新参数

 Update update=new Update();
        update.set("sex","未知");
        update.set("email","898989@qq.com");
        update.set("work","焊武大帝");
        UpdateOptions updateOptions=new UpdateOptions();
        updateOptions.upsert(false);
        Query query = new Query();
        Criteria criteria=new Criteria();
        criteria.and("phone").in(collect);
        query.addCriteria(criteria);

3.具体更新

 long l2= System.currentTimeMillis();
 mongoTemplate.updateMulti(query, update, User.class,"animals");
long l3= System.currentTimeMillis();
 System.out.println(">>>>>>>>>>>>>>>:"+(l3-l2));

4.结果

>>>>>>>>>>>:2379(查询整个集合一个字段出来在2.5s以内)
>>>>>>>>>>>>>>>:7629(更新50w控制在8s以内)
总计在12s以内,还可以接受

 

具体写法二:
1.0  List<Pair<Query, Update>> updates=new ArrayList<>();
        collect.stream().forEach(ele->{
            Query query1 = new Query();
            query1.addCriteria(new Criteria().and("phone").is(ele));
            Update update0=new Update();
            update0.set("sex","未知");
            update0.set("email","898989@qq.com");
            update0.set("work","焊武大帝");
            Pair<Query, Update> of = Pair.of(query1, update0);
            updates.add(of);
        });
        BulkOperations bulkOps = mongoTemplate.bulkOps(BulkOperations.BulkMode.UNORDERED, "animals");


     bulkOps.updateMulti(updates);
        bulkOps.execute();
        long l3= System.currentTimeMillis();
        System.out.println(">>>>>>>>>>>>>>>:"+(l3-l2));

2.0结果
>>>>>>>>>>>:2434(查询50w)
>>>>>>>>>>>>>>>:32490(执行50w,比上次时间高出了4倍!)