我需要读-50的文件在每个服务器启动和地方各文本文件的代表进入存储器。每个文本的文件将具有其自己的string(这是最好的类型使用的字符串架?).

什么是最快的方式来阅读该文件,进入存储,以及什么是最佳数据结构类型,以保持文本中的这样我就可以操控它在存储器(搜索和更换主要的)?

感谢

有帮助吗?

解决方案

存储器的映射文件将以最快的...事情是这样的:

    final File             file;
    final FileChannel      channel;
    final MappedByteBuffer buffer;

    file    = new File(fileName);
    fin     = new FileInputStream(file);
    channel = fin.getChannel();
    buffer  = channel.map(MapMode.READ_ONLY, 0, file.length());

然后继续读字节的缓冲区。

这将显着快于 FileInputStreamFileReader.

编辑:

后一位调查这个事实证明,这取决于你的操作系统,你可能会更好采用一个新的 BufferedInputStream(new FileInputStream(file)) 代替。然而阅读了整个事情都在一旦进入一个char[]文件大小的听起来像最糟糕的方式。

所以 BufferedInputStream 应该给大致一致性对所有的平台,同时存储器映文件可以是缓慢或快速取决于基础的操作系统。为与一切是性能至关重要的你应该测试你的代码,见到什么效果最好。

编辑:

确定这里有一些测试(第一个是做了两次获得的文件进入磁盘缓冲存储)。

我运行了它在这rt.jar 类文件,提取的硬盘驱动器,这是在Windows7测试64.这是16784文件与共94,706,637字节。

第一个结果...

(还记得第一次的重复,获得磁盘缓setup)

  • ArrayTest

    • 时间=83016
    • 字节=118641472
  • ArrayTest

    • 时间=46570
    • 字节=118641472
  • DataInputByteAtATime

    • 时间=74735
    • 字节=118641472
  • DataInputReadFully

    • 时间=8953
    • 字节=118641472
  • MemoryMapped

    • 时间=2320
    • 字节=118641472

这里的代码...

import java.io.BufferedInputStream;
import java.io.DataInputStream;
import java.io.File;
import java.io.FileInputStream;
import java.io.IOException;
import java.io.InputStream;
import java.nio.MappedByteBuffer;
import java.nio.channels.FileChannel;
import java.nio.channels.FileChannel.MapMode;
import java.util.HashSet;
import java.util.Set;

public class Main
{
    public static void main(final String[] argv)
    {
        ArrayTest.main(argv);
        ArrayTest.main(argv);
        DataInputByteAtATime.main(argv);
        DataInputReadFully.main(argv);
        MemoryMapped.main(argv);
    }
}

abstract class Test
{
    public final void run(final File root)
    {
        final Set<File> files;
        final long      size;
        final long      start;
        final long      end;
        final long      total;

        files = new HashSet<File>();
        getFiles(root, files);

        start = System.currentTimeMillis();

        size = readFiles(files);

        end = System.currentTimeMillis();
        total = end - start;

        System.out.println(getClass().getName());
        System.out.println("time  = " + total);
        System.out.println("bytes = " + size);
    }

    private void getFiles(final File      dir,
                          final Set<File> files)
    {
        final File[] childeren;

        childeren = dir.listFiles();

        for(final File child : childeren)
        {
            if(child.isFile())
            {
                files.add(child);
            }
            else
            {
                getFiles(child, files);
            }
        }
    }

    private long readFiles(final Set<File> files)
    {
        long size;

        size = 0;

        for(final File file : files)
        {
            size += readFile(file);
        }

        return (size);
    }

    protected abstract long readFile(File file);
}

class ArrayTest
    extends Test
{
    public static void main(final String[] argv)
    {
        final Test test;

        test = new ArrayTest();
        test.run(new File(argv[0]));
    }

    protected long readFile(final File file)
    {
        InputStream stream;

        stream = null;

        try
        {
            final byte[] data;
            int          soFar;
            int          sum;

            stream = new BufferedInputStream(new FileInputStream(file));
            data   = new byte[(int)file.length()];
            soFar  = 0;

            do
            {
                soFar += stream.read(data, soFar, data.length - soFar);
            }
            while(soFar != data.length);

            sum = 0;

            for(final byte b : data)
            {
                sum += b;
            }

            return (sum);
        }
        catch(final IOException ex)
        {
            ex.printStackTrace();
        }
        finally
        {
            if(stream != null)
            {
                try
                {
                    stream.close();
                }
                catch(final IOException ex)
                {
                    ex.printStackTrace();
                }
            }
        }

        return (0);
    }
}

class DataInputByteAtATime
    extends Test
{
    public static void main(final String[] argv)
    {
        final Test test;

        test = new DataInputByteAtATime();
        test.run(new File(argv[0]));
    }

    protected long readFile(final File file)
    {
        DataInputStream stream;

        stream = null;

        try
        {
            final int fileSize;
            int       sum;

            stream   = new DataInputStream(new BufferedInputStream(new FileInputStream(file)));
            fileSize = (int)file.length();
            sum      = 0;

            for(int i = 0; i < fileSize; i++)
            {
                sum += stream.readByte();
            }

            return (sum);
        }
        catch(final IOException ex)
        {
            ex.printStackTrace();
        }
        finally
        {
            if(stream != null)
            {
                try
                {
                    stream.close();
                }
                catch(final IOException ex)
                {
                    ex.printStackTrace();
                }
            }
        }

        return (0);
    }
}

class DataInputReadFully
    extends Test
{
    public static void main(final String[] argv)
    {
        final Test test;

        test = new DataInputReadFully();
        test.run(new File(argv[0]));
    }

    protected long readFile(final File file)
    {
        DataInputStream stream;

        stream = null;

        try
        {
            final byte[] data;
            int          sum;

            stream = new DataInputStream(new BufferedInputStream(new FileInputStream(file)));
            data   = new byte[(int)file.length()];
            stream.readFully(data);

            sum = 0;

            for(final byte b : data)
            {
                sum += b;
            }

            return (sum);
        }
        catch(final IOException ex)
        {
            ex.printStackTrace();
        }
        finally
        {
            if(stream != null)
            {
                try
                {
                    stream.close();
                }
                catch(final IOException ex)
                {
                    ex.printStackTrace();
                }
            }
        }

        return (0);
    }
}

class DataInputReadInChunks
    extends Test
{
    public static void main(final String[] argv)
    {
        final Test test;

        test = new DataInputReadInChunks();
        test.run(new File(argv[0]));
    }

    protected long readFile(final File file)
    {
        DataInputStream stream;

        stream = null;

        try
        {
            final byte[] data;
            int          size;
            final int    fileSize;
            int          sum;

            stream   = new DataInputStream(new BufferedInputStream(new FileInputStream(file)));
            fileSize = (int)file.length();
            data     = new byte[512];
            size     = 0;
            sum      = 0;

            do
            {
                size += stream.read(data);

                sum = 0;

                for(int i = 0; i < size; i++)
                {
                    sum += data[i];
                }
            }
            while(size != fileSize);

            return (sum);
        }
        catch(final IOException ex)
        {
            ex.printStackTrace();
        }
        finally
        {
            if(stream != null)
            {
                try
                {
                    stream.close();
                }
                catch(final IOException ex)
                {
                    ex.printStackTrace();
                }
            }
        }

        return (0);
    }
}
class MemoryMapped
    extends Test
{
    public static void main(final String[] argv)
    {
        final Test test;

        test = new MemoryMapped();
        test.run(new File(argv[0]));
    }

    protected long readFile(final File file)
    {
        FileInputStream stream;

        stream = null;

        try
        {
            final FileChannel      channel;
            final MappedByteBuffer buffer;
            final int              fileSize;
            int                    sum;

            stream   = new FileInputStream(file);
            channel  = stream.getChannel();
            buffer   = channel.map(MapMode.READ_ONLY, 0, file.length());
            fileSize = (int)file.length();
            sum      = 0;

            for(int i = 0; i < fileSize; i++)
            {
                sum += buffer.get();
            }

            return (sum);
        }
        catch(final IOException ex)
        {
            ex.printStackTrace();
        }
        finally
        {
            if(stream != null)
            {
                try
                {
                    stream.close();
                }
                catch(final IOException ex)
                {
                    ex.printStackTrace();
                }
            }
        }

        return (0);
    }
}

其他提示

最有效的方式是:

  • 确定长度的文件(文件File.length())
  • 创建一个焦炭缓冲区同样大小(或稍大)
  • 确定 编码 该文件
  • 使用 new InputStreamReader (new FileInputStream(file), encoding) 阅读
  • 阅读该文件,同时进入缓冲区与一个单一的呼吁read().注意,阅读()可能返回的早期(不具有阅读完整的文件)。在这种情况下,呼吁它再次具有偏读下一批处理。
  • 创建string: new String(buffer)

如果你需要搜索和替换一旦启动时,使用的字符串。replaceAll().

如果你需要做很多次,你可以考虑使用StringBuilder.它没有replaceAll()但是你可以用它来操作的角阵地(->有分配的存储器)。

这说:

  1. 让你的代码作为短期和简单,因为可能。
  2. 测量性能
  3. 它太慢,解决它。

没有任何理由要浪费很多时间进入这个代码跑得快如果它只需0.1s到执行。

如果你还有一个业绩问题,考虑到把所有文本文件纳入一个罐子,将它添加到类路径和使用类。getResourceAsStream()阅读本文件。载荷的东西,从Java类路径中是高度优化。

这很大程度上取决于文本文件的内部结构以及您打算用它们做什么。

文件是键值字典(即“属性”文件)吗? XML? JSON?你有那些标准结构。

如果它们具有正式结构,您也可以使用JavaCC来构建文件的对象表示。

否则,如果它们只是数据blob,那么,读取文件并将它们放在一个字符串中。

编辑关于搜索&amp; replace- juste使用 String的replaceAll函数

在搜索谷歌搜索有关Java速度的现有测试之后,我必须说TofuBear的测试用例完全打开了我的眼睛。你必须在自己的平台上运行他的测试,看看你最快的是什么。

在运行他的测试并添加一些我自己的(感谢TofuBear用于发布他的原始代码)之后,看起来你可以通过使用自己的自定义缓冲区而不是使用BufferedInputStream来获得更快的速度。

令我沮丧的是,NIO ByteBuffer表现不佳。

注意:静态byte []缓冲区削减了几毫秒,但静态ByteBuffers实际上增加了处理时间! 代码有什么问题吗?

我添加了一些测试:

  1. ArrayTest_CustomBuffering(直接将数据读入我自己的缓冲区)

  2. ArrayTest_CustomBuffering_StaticBuffer(将数据读入一个开头只创建一次的静态缓冲区)

  3. FileChannelArrayByteBuffer(使用NIO ByteBuffer并包装自己的byte []数组)

  4. FileChannelAllocateByteBuffer(使用带有.allocate的NIO ByteBuffer)

  5. FileChannelAllocateByteBuffer_StaticBuffer(与4相同,但带有静态缓冲区)

  6. FileChannelAllocateDirectByteBuffer(使用NIO ByteBuffer和.allocateDirect)

  7. FileChannelAllocateDirectByteBuffer_StaticBuffer(与6相同,但带有静态缓冲区)

  8. 以下是我的结果:在解压缩的rt.jar上使用Windows Vista和jdk1.6.0_13: ArrayTest中点击 时间= 2075
    bytes = 2120336424
    ArrayTest中点击 时间= 2044年 bytes = 2120336424
    ArrayTest_CustomBuffering结果 时间= 1903年 bytes = 2120336424
    ArrayTest_CustomBuffering_StaticBuffer结果 时间= 1872年 bytes = 2120336424
    DataInputByteAtATime结果 时间= 2668
    bytes = 2120336424
    DataInputReadFully结果 时间= 2028年 bytes = 2120336424
    存储器映射结果 时间= 2901
    bytes = 2120336424
    FileChannelArrayByteBuffer结果 时间= 2371
    bytes = 2120336424
    FileChannelAllocateByteBuffer结果 时间= 2356
    bytes = 2120336424
    FileChannelAllocateByteBuffer_StaticBuffer结果 时间= 2668
    bytes = 2120336424
    FileChannelAllocateDirectByteBuffer结果 时间= 2512
    bytes = 2120336424
    FileChannelAllocateDirectByteBuffer_StaticBuffer结果 时间= 2590
    bytes = 2120336424

    我的黑客版TofuBear的代码:

    import java.io.BufferedInputStream;
    import java.io.DataInputStream;
    import java.io.File;
    import java.io.FileInputStream;
    import java.io.IOException;
    import java.io.InputStream;
    import java.nio.MappedByteBuffer;
    import java.nio.ByteBuffer;
    import java.nio.channels.FileChannel;
    import java.nio.channels.FileChannel.MapMode;
    import java.util.HashSet;
    import java.util.Set;
    public class Main { 
        public static void main(final String[] argv)     { 
            ArrayTest.mainx(argv);
            ArrayTest.mainx(argv);
            ArrayTest_CustomBuffering.mainx(argv);
            ArrayTest_CustomBuffering_StaticBuffer.mainx(argv);
            DataInputByteAtATime.mainx(argv);
            DataInputReadFully.mainx(argv);
            MemoryMapped.mainx(argv);
            FileChannelArrayByteBuffer.mainx(argv);
            FileChannelAllocateByteBuffer.mainx(argv);
            FileChannelAllocateByteBuffer_StaticBuffer.mainx(argv);
            FileChannelAllocateDirectByteBuffer.mainx(argv);
            FileChannelAllocateDirectByteBuffer_StaticBuffer.mainx(argv);
         } 
     } 
    abstract class Test { 
        static final int BUFF_SIZE = 20971520;
        static final byte[] StaticData = new byte[BUFF_SIZE];
        static final ByteBuffer StaticBuffer =ByteBuffer.allocate(BUFF_SIZE);
        static final ByteBuffer StaticDirectBuffer = ByteBuffer.allocateDirect(BUFF_SIZE);
        public final void run(final File root)     { 
            final Set<File> files;
            final long      size;
            final long      start;
            final long      end;
            final long      total;
            files = new HashSet<File>();
            getFiles(root, files);
            start = System.currentTimeMillis();
            size = readFiles(files);
            end = System.currentTimeMillis();
            total = end - start;
            System.out.println(getClass().getName());
            System.out.println("time  = " + total);
            System.out.println("bytes = " + size);
         } 
        private void getFiles(final File dir,final Set<File> files)     { 
            final File[] childeren;
            childeren = dir.listFiles();
            for(final File child : childeren)         { 
                if(child.isFile())             { 
                    files.add(child);
                 } 
                else             { 
                    getFiles(child, files);
                 } 
             } 
         } 
        private long readFiles(final Set<File> files)     { 
            long size;
            size = 0;
            for(final File file : files)         { 
                size += readFile(file);
             } 
            return (size);
         } 
        protected abstract long readFile(File file);
     } 
    class ArrayTest    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new ArrayTest();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            InputStream stream;
            stream = null;
            try         { 
                final byte[] data;
                int          soFar;
                int          sum;
                stream = new BufferedInputStream(new FileInputStream(file));
                data   = new byte[(int)file.length()];
                soFar  = 0;
                do             { 
                    soFar += stream.read(data, soFar, data.length - soFar);
                 } 
                while(soFar != data.length);
                sum = 0;
                for(final byte b : data)             { 
                    sum += b;
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     } 
    
     class ArrayTest_CustomBuffering    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new ArrayTest_CustomBuffering();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            InputStream stream;
            stream = null;
            try         { 
                final byte[] data;
                int          soFar;
                int          sum;
                stream = new FileInputStream(file);
                data   = new byte[(int)file.length()];
                soFar  = 0;
                do             { 
                    soFar += stream.read(data, soFar, data.length - soFar);
                 } 
                while(soFar != data.length);
                sum = 0;
                for(final byte b : data)             { 
                    sum += b;
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     }
    
     class ArrayTest_CustomBuffering_StaticBuffer    extends Test { 
    
    
    
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new ArrayTest_CustomBuffering_StaticBuffer();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            InputStream stream;
            stream = null;
            try         { 
                int          soFar;
                int          sum;
                final int    fileSize;
                stream = new FileInputStream(file);
                fileSize = (int)file.length();
                soFar  = 0;
                do             { 
                    soFar += stream.read(StaticData, soFar, fileSize - soFar);
                 } 
                while(soFar != fileSize);
                sum = 0;
                for(int i=0;i<fileSize;i++)             { 
                    sum += StaticData[i];
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     }
    
    class DataInputByteAtATime    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new DataInputByteAtATime();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            DataInputStream stream;
            stream = null;
            try         { 
                final int fileSize;
                int       sum;
                stream   = new DataInputStream(new BufferedInputStream(new FileInputStream(file)));
                fileSize = (int)file.length();
                sum      = 0;
                for(int i = 0; i < fileSize; i++)             { 
                    sum += stream.readByte();
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     } 
    class DataInputReadFully    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new DataInputReadFully();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            DataInputStream stream;
            stream = null;
            try         { 
                final byte[] data;
                int          sum;
                stream = new DataInputStream(new BufferedInputStream(new FileInputStream(file)));
                data   = new byte[(int)file.length()];
                stream.readFully(data);
                sum = 0;
                for(final byte b : data)             { 
                    sum += b;
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     } 
    class DataInputReadInChunks    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new DataInputReadInChunks();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            DataInputStream stream;
            stream = null;
            try         { 
                final byte[] data;
                int          size;
                final int    fileSize;
                int          sum;
                stream   = new DataInputStream(new BufferedInputStream(new FileInputStream(file)));
                fileSize = (int)file.length();
                data     = new byte[512];
                size     = 0;
                sum      = 0;
                do             { 
                    size += stream.read(data);
                    sum = 0;
                    for(int i = 0;
     i < size;
     i++)                 { 
                        sum += data[i];
                     } 
                 } 
                while(size != fileSize);
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     } 
    class MemoryMapped    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new MemoryMapped();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            FileInputStream stream;
            stream = null;
            try         { 
                final FileChannel      channel;
                final MappedByteBuffer buffer;
                final int              fileSize;
                int                    sum;
                stream   = new FileInputStream(file);
                channel  = stream.getChannel();
                buffer   = channel.map(MapMode.READ_ONLY, 0, file.length());
                fileSize = (int)file.length();
                sum      = 0;
    
                for(int i = 0; i < fileSize; i++)             { 
                    sum += buffer.get();
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     } 
    
     class FileChannelArrayByteBuffer    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new FileChannelArrayByteBuffer();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            FileInputStream stream;
            stream = null;
            try         { 
                final byte[] data;
                final FileChannel      channel;
                final ByteBuffer       buffer;
                int                    nRead=0;
                final int              fileSize;
                int                    sum;
                stream = new  FileInputStream(file);
                data   = new byte[(int)file.length()];
                buffer = ByteBuffer.wrap(data);
    
                channel  = stream.getChannel();
                fileSize = (int)file.length();
                nRead += channel.read(buffer);
    
                buffer.rewind();
                sum      = 0;
                for(int i = 0; i < fileSize; i++)             { 
                    sum += buffer.get();
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     } 
    
     class FileChannelAllocateByteBuffer    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new FileChannelAllocateByteBuffer();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            FileInputStream stream;
            stream = null;
            try         { 
                final byte[] data;
                final FileChannel      channel;
                final ByteBuffer       buffer;
                int                    nRead=0;
                final int              fileSize;
                int                    sum;
                stream = new  FileInputStream(file);
                //data   = new byte[(int)file.length()];
                buffer = ByteBuffer.allocate((int)file.length());
    
                channel  = stream.getChannel();
                fileSize = (int)file.length();
                nRead += channel.read(buffer);
    
                buffer.rewind();
                sum      = 0;
                for(int i = 0; i < fileSize; i++)             { 
                    sum += buffer.get();
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     } 
    
     class FileChannelAllocateDirectByteBuffer    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new FileChannelAllocateDirectByteBuffer();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            FileInputStream stream;
            stream = null;
            try         { 
                final byte[] data;
                final FileChannel      channel;
                final ByteBuffer       buffer;
                int                    nRead=0;
                final int              fileSize;
                int                    sum;
                stream = new  FileInputStream(file);
                //data   = new byte[(int)file.length()];
                buffer = ByteBuffer.allocateDirect((int)file.length());
    
                channel  = stream.getChannel();
                fileSize = (int)file.length();
                nRead += channel.read(buffer);
    
                buffer.rewind();
                sum      = 0;
                for(int i = 0; i < fileSize; i++)             { 
                    sum += buffer.get();
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     }
    
     class FileChannelAllocateByteBuffer_StaticBuffer    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new FileChannelAllocateByteBuffer_StaticBuffer();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            FileInputStream stream;
            stream = null;
            try         { 
                final byte[] data;
                final FileChannel      channel;
                int                    nRead=0;
                final int              fileSize;
                int                    sum;
                stream = new  FileInputStream(file);
                //data   = new byte[(int)file.length()];
                StaticBuffer.clear();
                StaticBuffer.limit((int)file.length());
                channel  = stream.getChannel();
                fileSize = (int)file.length();
                nRead += channel.read(StaticBuffer);
    
                StaticBuffer.rewind();
                sum      = 0;
                for(int i = 0; i < fileSize; i++)             { 
                    sum += StaticBuffer.get();
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     }
    
     class FileChannelAllocateDirectByteBuffer_StaticBuffer    extends Test { 
        public static void mainx(final String[] argv)     { 
            final Test test;
            test = new FileChannelAllocateDirectByteBuffer_StaticBuffer();
            test.run(new File(argv[0]));
         } 
        protected long readFile(final File file)     { 
            FileInputStream stream;
            stream = null;
            try         { 
                final byte[] data;
                final FileChannel      channel;
                int                    nRead=0;
                final int              fileSize;
                int                    sum;
                stream = new  FileInputStream(file);
                //data   = new byte[(int)file.length()];
                StaticDirectBuffer.clear();
                StaticDirectBuffer.limit((int)file.length());
                channel  = stream.getChannel();
                fileSize = (int)file.length();
                nRead += channel.read(StaticDirectBuffer);
    
                StaticDirectBuffer.rewind();
                sum      = 0;
                for(int i = 0; i < fileSize; i++)             { 
                    sum += StaticDirectBuffer.get();
                 } 
                return (sum);
             } 
            catch(final IOException ex)         { 
                ex.printStackTrace();
             } 
            finally         { 
                if(stream != null)             { 
                    try                 { 
                        stream.close();
                     } 
                    catch(final IOException ex)                 { 
                        ex.printStackTrace();
                     } 
                 } 
             } 
            return (0);
         } 
     }
    

任何传统方法的速度都会受到限制。我不确定你会看到一种方法与下一种方法有很大不同。

我会专注于可以使整个操作更快的商业技巧。

例如,如果您读取所有文件并将它们存储在一个文件中,并带有来自每个原始文件的时间戳,那么您可以检查是否有任何文件已更改而未实际打开它们。 (换句话说,一个简单的缓存)。

如果您的问题是快速启动GUI,您可能会在显示第一个屏幕后找到在后台线程中打开文件的方法。

操作系统可以很好地处理文件,如果这是批处理过程的一部分(没有用户I / O),你可以从批处理文件开始,该文件在启动java之前将所有文件附加到一个大文件中,使用某些东西像这样:

echo "file1" > file.all
type "file1" >> file.all
echo "file2" >> file.all
type "file2" >> file.all

然后只需打开file.all(我不确定这会有多快,但它可能是我刚才所说条件的最快方法)

我想我只是说,通常情况下,速度问题的解决方案通常需要稍微扩展您的观点并使用新参数完全重新思考解决方案。对现有算法的修改通常只会以可读性为代价提供较小的速度增强。

您应该能够使用Commons IO FileUtils.readFileToString(File)等标准工具在一秒钟内读取所有文件

您也可以使用writeStringToFile(File,String)来保存修改后的文件。

http:/ /commons.apache.org/io/api-release/index.html?org/apache/commons/io/FileUtils.html

BTW:50不是大量文件。典型的PC可以有100K或更多文件。

许可以下: CC-BY-SA归因
不隶属于 StackOverflow
scroll top