Cross platform way to convert UTF8 to std :: wstring
Possible duplicate:
UTF8 to / from wide char to STL conversion
I know how to convert UTF8 to std :: wstring using MultiByteToWideChar :
std::wstring utf8to16( const char* src )
{
std::vector<wchar_t> buffer;
buffer.resize(MultiByteToWideChar(CP_UTF8, 0, src, -1, 0, 0));
MultiByteToWideChar(CP_UTF8, 0, src, -1, &buffer[0], buffer.size());
return &buffer[0];
}
but it depends on Windows, is there a C ++ cross platform function that does the same using only stdio or iostream?
+3
source to share
1 answer
I suggest using the utf8-cpp library , it's simple and important when it comes to utf8 strings.
this code reads a UTF-8 file and creates a utf16 version of each string, then converts back to utf-8
#include <fstream>
#include <iostream>
#include <string>
#include <vector>
#include "utf8.h"
using namespace std;
int main(int argc, char** argv)
{
if (argc != 2) {
cout << "\nUsage: docsample filename\n";
return 0;
}
const char* test_file_path = argv[1];
// Open the test file (contains UTF-8 encoded text)
ifstream fs8(test_file_path);
if (!fs8.is_open()) {
cout << "Could not open " << test_file_path << endl;
return 0;
}
string line;
while (getline(fs8, line)) {
// Convert the line to utf-16
vector<unsigned short> utf16line;
utf8::utf8to16(line.begin(), end_it, back_inserter(utf16line));
// And back to utf-8
string utf8line;
utf8::utf16to8(utf16line.begin(), utf16line.end(), back_inserter(utf8line));
}
return 0;
}
+2
source to share