数组去重_ASM，1000万数据，毫秒级去重复，支持通用型数组

梦幻1096

  

子程序名	返回值类型	公开	备 注
数组去重	整数型		将未重复数据移动到数组前端，将重复数据移动到数组末尾，并返回分界点下标,by契丶梦幻 qq1096194951
参数名	类 型	参考	可空	数组	备 注
数组	通用型
数组类型	整数型				仅支持基本数据类型

变量名	类 型	静态	数组	备 注
len	整数型
缓冲区	字节集

置入代码 ({ 139, 69, 8, 139, 0, 139, 64, 4, 133, 192, 117, 4, 93, 194, 8, 0, 64, 107, 192, 20, 137, 69, 248 })
缓冲区 ＝ 取空白字节集 (len)
置入代码 ({ 131, 236, 28, 199, 69, 248, 0, 0, 0, 0, 131, 192, 8, 137, 69, 244, 232, 0, 0, 0, 0, 235, 9, 4, 4, 4, 8, 4, 8, 4, 8, 4, 88, 131, 192, 5, 137, 69, 220, 139, 69, 8, 139, 0, 139, 88, 4, 137, 93, 240, 193, 227, 2, 3, 93, 244, 131, 195, 4, 137, 93, 224, 131, 192, 8, 137, 69, 228, 49, 201, 65, 59, 77, 240, 15, 135, 231, 1, 0, 0, 81, 131, 125, 12, 10, 117, 58, 139, 24, 137, 216, 133, 192, 15, 132, 175, 1, 0, 0, 141, 80, 3, 139, 56, 131, 192, 4, 141, 143, 255, 254, 254, 254, 247, 215, 33, 249, 129, 225, 128, 128, 128, 128, 116, 233, 247, 193, 128, 128, 0, 0, 117, 6, 193, 233, 16, 131, 192, 2, 208, 225, 25, 208, 235, 37, 131, 125, 12, 11, 117, 18, 139, 24, 139, 67, 4, 133, 192, 15, 132, 110, 1, 0, 0, 141, 91, 8, 235, 13, 137, 195, 139, 85, 12, 139, 69, 220, 15, 182, 68, 16, 252, 80, 137, 223, 131, 248, 4, 117, 4, 139, 7, 235, 58, 49, 210, 187, 4, 0, 0, 0, 247, 243, 137, 193, 184, 197, 157, 28, 129, 187, 147, 1, 0, 1, 133, 201, 116, 11, 51, 7, 15, 175, 195, 131, 199, 4, 73, 117, 245, 137, 209, 49, 210, 133, 201, 116, 14, 138, 23, 193, 226, 8, 71, 73, 117, 247, 49, 208, 15, 175, 195, 89, 133, 192, 121, 3, 247, 208, 64, 137, 69, 236, 137, 77, 232, 49, 210, 139, 93, 240, 131, 203, 1, 247, 243, 193, 226, 2, 139, 69, 244, 1, 208, 139, 16, 133, 210, 15, 132, 135, 0, 0, 0, 139, 26, 59, 93, 236, 117, 117, 139, 90, 8, 59, 93, 232, 117, 109, 89, 81, 83, 139, 69, 8, 139, 0, 131, 192, 8, 131, 125, 12, 10, 115, 32, 131, 125, 232, 8, 117, 13, 139, 90, 12, 141, 116, 216, 248, 141, 124, 200, 248, 235, 28, 139, 90, 12, 141, 116, 152, 252, 141, 124, 136, 252, 235, 15, 139, 90, 12, 141, 116, 152, 252, 139, 54, 141, 124, 136, 252, 139, 63, 91, 137, 217, 193, 233, 2, 116, 15, 139, 6, 59, 7, 117, 31, 131, 198, 4, 131, 199, 4, 73, 117, 241, 137, 217, 131, 225, 3, 133, 201, 116, 125, 138, 6, 58, 7, 117, 7, 70, 71, 73, 117, 245, 235, 112, 141, 66, 4, 139, 82, 4, 233, 113, 255, 255, 255, 139, 85, 224, 131, 69, 224, 16, 137, 16, 139, 69, 236, 137, 2, 139, 69, 232, 137, 66, 8, 89, 81, 255, 69, 248, 59, 77, 248, 116, 65, 139, 93, 248, 139, 69, 8, 139, 0, 131, 192, 8, 131, 125, 12, 10, 115, 34, 131, 125, 232, 8, 117, 28, 141, 92, 216, 248, 141, 76, 200, 248, 139, 3, 135, 1, 137, 3, 131, 195, 4, 131, 193, 4, 139, 3, 135, 1, 137, 3, 235, 14, 141, 92, 152, 252, 141, 76, 136, 252, 139, 3, 135, 1, 137, 3, 139, 69, 248, 137, 66, 12, 89, 139, 69, 8, 139, 0, 131, 192, 8, 131, 125, 12, 10, 115, 14, 131, 125, 232, 8, 117, 8, 141, 4, 200, 233, 23, 254, 255, 255, 141, 4, 136, 233, 15, 254, 255, 255 })
返回 (len)

.版本 2<br /> <br /> .子程序 数组去重, 整数型, , 将未重复数据移动到数组前端，将重复数据移动到数组末尾，并返回分界点下标,by契丶梦幻 qq1096194951<br /> .参数 数组, 通用型, 参考 数组<br /> .参数 数组类型, 整数型, , 仅支持基本数据类型<br /> .局部变量 len, 整数型<br /> .局部变量 缓冲区, 字节集<br /> <br /> 置入代码 ({ 139, 69, 8, 139, 0, 139, 64, 4, 133, 192, 117, 4, 93, 194, 8, 0, 64, 107, 192, 20, 137, 69, 248 })<br /> 缓冲区 ＝ 取空白字节集 (len)<br /> 置入代码 ({ 131, 236, 28, 199, 69, 248, 0, 0, 0, 0, 131, 192, 8, 137, 69, 244, 232, 0, 0, 0, 0, 235, 9, 4, 4, 4, 8, 4, 8, 4, 8, 4, 88, 131, 192, 5, 137, 69, 220, 139, 69, 8, 139, 0, 139, 88, 4, 137, 93, 240, 193, 227, 2, 3, 93, 244, 131, 195, 4, 137, 93, 224, 131, 192, 8, 137, 69, 228, 49, 201, 65, 59, 77, 240, 15, 135, 231, 1, 0, 0, 81, 131, 125, 12, 10, 117, 58, 139, 24, 137, 216, 133, 192, 15, 132, 175, 1, 0, 0, 141, 80, 3, 139, 56, 131, 192, 4, 141, 143, 255, 254, 254, 254, 247, 215, 33, 249, 129, 225, 128, 128, 128, 128, 116, 233, 247, 193, 128, 128, 0, 0, 117, 6, 193, 233, 16, 131, 192, 2, 208, 225, 25, 208, 235, 37, 131, 125, 12, 11, 117, 18, 139, 24, 139, 67, 4, 133, 192, 15, 132, 110, 1, 0, 0, 141, 91, 8, 235, 13, 137, 195, 139, 85, 12, 139, 69, 220, 15, 182, 68, 16, 252, 80, 137, 223, 131, 248, 4, 117, 4, 139, 7, 235, 58, 49, 210, 187, 4, 0, 0, 0, 247, 243, 137, 193, 184, 197, 157, 28, 129, 187, 147, 1, 0, 1, 133, 201, 116, 11, 51, 7, 15, 175, 195, 131, 199, 4, 73, 117, 245, 137, 209, 49, 210, 133, 201, 116, 14, 138, 23, 193, 226, 8, 71, 73, 117, 247, 49, 208, 15, 175, 195, 89, 133, 192, 121, 3, 247, 208, 64, 137, 69, 236, 137, 77, 232, 49, 210, 139, 93, 240, 131, 203, 1, 247, 243, 193, 226, 2, 139, 69, 244, 1, 208, 139, 16, 133, 210, 15, 132, 135, 0, 0, 0, 139, 26, 59, 93, 236, 117, 117, 139, 90, 8, 59, 93, 232, 117, 109, 89, 81, 83, 139, 69, 8, 139, 0, 131, 192, 8, 131, 125, 12, 10, 115, 32, 131, 125, 232, 8, 117, 13, 139, 90, 12, 141, 116, 216, 248, 141, 124, 200, 248, 235, 28, 139, 90, 12, 141, 116, 152, 252, 141, 124, 136, 252, 235, 15, 139, 90, 12, 141, 116, 152, 252, 139, 54, 141, 124, 136, 252, 139, 63, 91, 137, 217, 193, 233, 2, 116, 15, 139, 6, 59, 7, 117, 31, 131, 198, 4, 131, 199, 4, 73, 117, 241, 137, 217, 131, 225, 3, 133, 201, 116, 125, 138, 6, 58, 7, 117, 7, 70, 71, 73, 117, 245, 235, 112, 141, 66, 4, 139, 82, 4, 233, 113, 255, 255, 255, 139, 85, 224, 131, 69, 224, 16, 137, 16, 139, 69, 236, 137, 2, 139, 69, 232, 137, 66, 8, 89, 81, 255, 69, 248, 59, 77, 248, 116, 65, 139, 93, 248, 139, 69, 8, 139, 0, 131, 192, 8, 131, 125, 12, 10, 115, 34, 131, 125, 232, 8, 117, 28, 141, 92, 216, 248, 141, 76, 200, 248, 139, 3, 135, 1, 137, 3, 131, 195, 4, 131, 193, 4, 139, 3, 135, 1, 137, 3, 235, 14, 141, 92, 152, 252, 141, 76, 136, 252, 139, 3, 135, 1, 137, 3, 139, 69, 248, 137, 66, 12, 89, 139, 69, 8, 139, 0, 131, 192, 8, 131, 125, 12, 10, 115, 14, 131, 125, 232, 8, 117, 8, 141, 4, 200, 233, 23, 254, 255, 255, 141, 4, 136, 233, 15, 254, 255, 255 })<br /> 返回 (len)

这次直接改了个汇编版的，速度巨量提升，  有没有bug我也不清楚，我只随便测试了一下，如果又发现问题的话评论区留言吧

tan666

搞个例子呗。小白不会用

951902929

梦幻1096 发表于 2024-12-17 17:43
这个是将重复的数据移动到后面去了，返回一个索引，通过这个索引重定义数组就行了 ...

哦，原来如此。谢谢

梦幻1096

951902929 发表于 2024-12-17 09:50
emmm，我使用后是有提示重复数量，但是重复的数组没有清除，是我操作原因吗？还是bug ...

这个是将重复的数据移动到后面去了，返回一个索引，通过这个索引重定义数组就行了

951902929

emmm，我使用后是有提示重复数量，但是重复的数组没有清除，是我操作原因吗？还是bug

951902929

梦幻1096 发表于 2024-12-16 18:22
一次性分配的内存，太大的话可能会内存不足

好的，其实也够用了。

梦幻1096

951902929 发表于 2024-12-16 15:36
感谢分享，速度确实非常快。但是我加载了一个2000万的数据，提示错误信息；分配400000028字节内存失败！500 ...

一次性分配的内存，太大的话可能会内存不足

951902929

感谢分享，速度确实非常快。但是我加载了一个2000万的数据，提示错误信息；分配400000028字节内存失败！500万的数据没问题

梦幻1096

鹏peng 发表于 2024-12-13 16:43
请问一下通用型怎么使用，有大哥会吗

有插件可以直接使用的，论坛搜搜！

鹏peng

请问一下通用型怎么使用，有大哥会吗